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ABSTRACT 

This report docxunents the 1985-86 Title VII Program 
of the Austin (Texas) Independent School District. Major findings 
indicated the following: (1) three program components— staff 
training, tutoring, and curriculum development — were implement ,d as 
planned; (2) the staff training component included a series of 
English as a Second Language endorsement courses and teachers* 
checklist responses showed significant improvement in their ability 
to organize instruction and use audiovisv^als with Limited English 
Proficient (LEP) students; (3) both tutored and non tutored project 
LEP students made significant gains on the Language Assessment 
Battery (LAB), but tutored students did ;iot make significantly 
Qreater gains than nontutor^^d students; (4) as part of the curriculum 
ueveloiHnent component a resource collection of multilevel content 
area materials for four project schools were purchased and an 
annotated bibliography of multilevel instructional materials was 
developed; (5) Project LEP students at Murchison Junior High and 
Travis High Schools made significant gains in reading, language, 
mathematics, social studies, and science as measured by La Prueba 
Riverside de Realizacion en Espanol; and (6) proposed objectives that 
85% of students involved in Title VII would make gains on the Prueba 
Riverside, LAB, Iowa Tests of Basic Skills, or Tests of Achievement 
and Proficiency were not met. Seven appendices make up the majority 
of this document and are titled as follows: (1) Language Assessment 
Battery (LAB); (2) Iowa Tests of Basic Skills (ITBS), Tests of 
Achievement and Proficiency (TAP); (3) La Prueba Riverside de 
Realizacion en Espanol; (4) Criterion-Referenced Teacher Competency 
Checklist; (5) Administrator Interviews; (6) Teacher Survey; and (7) 
Tutor Records. (KSA) 
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TITLE VII PROGRAM — EVALUATION 1985-86 
EXECUTIVE SUMMARY 



AUTHORS: Barbara Yonan, Nancy Schuyler 



MAJOR FINDINGS 



1. The three program components ~ staff training, tutoring, and curriculum 
development ~ were generally implemented as planned. 

2. The staff training component included a series of Engl ish-as-a-Second 
Language (ESL) endorsement courses; 24 secondary teachers enrolled in the 
first two courses offered. Teachers* checklist responses showed 
significant improvement in their ability to organize instruction and use 
audiovisuals with LEP students. 

3. During school year 1985-86, 76 project students were tutored by 48 tutors 
in 18 subjects. The five major content areas covered were reading, 
language, mathematics, social studies, and science. While both tutored 
and nontutored project LEP students made very significant gains on the 
Language Assessment Battery (LAB), ti^ored students did not make 
significantly greater gains than nontutored students. 

4. As part of the curriculum development component in 1985-86: 

• Title VII Project purchased a resource collection of multilevel content 
area materials for each of the four project schools. 

• The first part of the handbook, an annotated bibliography of multilevel 
instructional materials, was developed. 

5. On the average, project LEP students at Murchison Junior High and Travis 
High Schools made significant gains in reading, language, mathematics, 
social studies, and science as measured by La Prueba Riverside de 
Realizacidn en Espanol (Prueba Riverside). 

6. Project objectives were that 85% of the students involved in Title VII 
would make gains on the Prueba Riverside, LAB, and Iowa Tests of Basic 
Skills (ITBS)/ Tests of Achievement and Proficiency (TAP). These 
objectives were not met. 
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WHAT IS THE TITLE VII PROGRAM? 

Title VII is a federally-funded program designed to improve the English 
proficiency and academic achievement of limited-English-proficient (LEP) 
students. The Austin Independent School District's (AISD) Title VII program 
for secondary students was first implemented in 1985-86. It is designed to 
enhance the District's regular program for Hispanic LEP students. This 
regular program includes: 

• Bilingual (English/Spanish) instruction in major content areas for 
students of limited English ability (Murchison Junior High only); 

• A new self-contained literacy program for recent Hispanic immigrants 
with limited schooling and English skills (Murchison' only); 

• English-as-a-Second Language (ESL) instruction, focusing on listening, 
speaking, and writing skills -for one period a day (all junior and 
senior high schools with LEP students); and 

• A new class, Spanish for Native Speakers, providing additional English 
instruction and work in translating Spanish to English and vice versa 
for limited English speakers (Travis High only). 

The 1935-86 Title VII program provided three additional services: 

• Staff training (through ESL endorsement courses and campus workshops), 

• Student tutoring, and 

• Curriculum development. 



WHO WAS ELIGIBLE FOR THE 1985-86 PROGRAM? 

Four campuses with the greatest concentration of Hispanic LEP students v-'ere 
served during 1985-86: Murchison Junior High, Anderson High, Johnston High 
and Travis High. 

LEP students monolingual in Spanish (category A) or dominant in Spanish with 
some limited English ability (category B) were eligible for Title VII program 
services at each of these campuses. 

LEP status is determined by the District's identification procedures in 
accordance with TEA and the United States Office for Civil Rights guidelines. 
The Language Assessment Battery (LAB) was used to determine language 
pro-Ficiency and dominance. 

All Title VII and AISD program services were not available at each campus in 
1985-86. The chart on the next page designates services provided by c'"ipus. 
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Title VIi Components 

1. Staff training 

2. Curriculum development 

3. Tutor Support 

AISD Programs 

1. Bilingual content area 
instruction 

2. English-as-a-Second Language 
(ESL) instruction 

3. Literacy program 

4. Spanish for Native Speakers 



Murcnison 



X 
X 
X 



X 

X 
X 



CAMPUSES 



Anderson Johnston 



X 
X 



X 
X 
X 



Travis 



X 
X 



X 
X 



Figure 1. 



SERVICES PROVIDED TO LIMITED-ENGLISH PROFICIENT STUDENTS 1985-86. 
Title VII and other AISD program services are reflected at the 
four campuses. 



^Tutoring was not provided at Anderson during the second semester 



STAFF TRAINING 
WHAT IS THE STAFF TRAINING COHPONENT? 

Two types of training were available to any teachers interested at the four 
campuses. 

• Secondary teachers from the four project schools involved in a series 
of four ESL endorsement courses, and 

• All interested staff and admin' trators at these campuses who were 
involved in a series of ESL techniques workshops. 

During the first two ESL endorsement courses, 24 secondary teachers at the 
four projects schools participated. Two more courses will lead to endorsement 
certification. Interested staff and administrators at tne four schools were 
involved in a series of ESI, techniques workshops. 

HOW EFFECTIVE WAS THE STAFF TRAINING COMPONENT? 

At the beginning of the semester, participants in the second ESL endorsement 
course were administered Teacher Self-Inventories, developed by the Office of 
Research and Evaluation. The self-inventory was a competency checklist on 
which teachers rated their ability to apply ESL methodology in the classroom. 
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There was a positive pattern of movement in responses between the pre- and 
post-surveys (see Figure 2). The means increased for 11 of 12 items. 
However, regression analyses revealed these differences in pre- and postrating 
means were significant in only two cases. Teachers felt better prepared to 
organize instruction and use audiovisuals to promote LEP student learning 
(Items 5 & 9). 

To meet the objective, participating teachers needed to master 85% of the 
project-related staff development skills presented to them during endorsement 
training sessions. In order to measure achievement of the objective, mastery 
was defined as agreeing or strongly agreeing with self-inventory statements. 
Of the 14 teachers responding, 6 reported feeling competent on 85% (10 of 12) 
of the items. Thus, the objective was not met as stated based on this measure. 

However, at least 70% of the posttest respondents saw themselves as competent 
in working with LEP students in terms of: 

t responding to specific language needs, 

t helping students stay on task, 

t making content area relevant and useful, 

t developing appropriate objectives. 

Course grades for the project teachers were also examined. A grade of "A" or 
"B" was used as the criterion for mastery. Of the 17 who completed the 
course, 10 (58%) met the criterion for staff development skill mastery. This 
also does vot provide support for achievement of the objective. 

According to these data, project teachers are increasing their ESL instruc- 
tional skills after two courses in the projected four course ESL endorsement 
series. However, as a group, they did not meet the desired 85% mastery level. 

Six workshops were implemented during the second semester of 1985-86 for 
interested educators of the four project schools. 

January 8, 1986 - How to adapt the textbook to uhe reading level of the 

limited English student 

January 22, 1986 - How to design content area lessons for the LEP student 

February 5, 1986 - How to unmotivate the LEP student 

February 19, 1986 - Prejudisms and stereotyping of LEP students 

March 5, 1986 - Madeline Hunter and the LEP student 

March 19, 1986 - How to use tutors effectively with LEP students in the 

classroom 



4 



8 



86.26 



Item 


N 

Pre 


Post 


Mean 
Pre Post 


1. 


I feel prepared to teach LEP students. 


17 


14 


3.53 


3.86 


2. 


I am comfortable teaching my content 
area to LEP. 


17 


13 


3.70 


4.00 


3. 


I am able to evoke class participation 
of my LEP students. 


14 


14 


3.86 


3.71 


4. 


I am responsive to LEP students' needs. 


16 


14 


3.44 


3.71 


5. 


My present organization of instruction 
is adequate to meet the needs of LEP 
students. 


17 


14 


2.59 


3.57* 


6. 


I can adequately help my LEP students 
stay on task. 


17 


14 


3.18 


3.86 


7. 


My instruction of the content area is 
relevant to and useful for LEP students. 


17 


14 


3.53 


4.07 


8. 


I can adequately design objectives 
appropriate for the needs of my LEP 
students. 


17 


14 


3.65 


3.86 


9. 


I can utilize audiovisual equipment 
effectively to augment LEP students 
learning. 


17 


14 


3.29 


4.07* 


10. 


I employ varied and student- 
appropriate evaluation strategies 
when assessing my LEP students. 


17 


14 


3.47 


3.86 


11. 


In terms of my instructional 
objectives, I am able to individualize 
activities appropriate for the special 
needs and levels of my LEP students. 


17 


14 


3.18 


3.57 


12. 


I employ a variety of strategies to 
clarify instruction (e.g. modeling, 
audiovisual examples, whole group 
responses, etc.) 


17 


14 


3.71 


3.86 




The scale ranged from Strongly Agree (5) to Strongly Disagree (1) 
*Items showing statistically significant gains. 



Figure 2. COMPARISON OF MEAN GAINS IN ESL METHODOLOGY AS MEASURED BY TEACHER 
SELF INVENTORIES. Responses were retained anonymously resulting in 
unequal sample samples pre and post. 
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TUTORING 

WHAT IS THE TUTORING COHPONEKT? 

University of Texas tutors enrolled in a multicultural education course were 
placed with LEP tutees in classes at Murchison and Johnston during the first 
semester of school year 1985-86. During the second semester tutors were also 
placed at Anderson. 

English speaking tutors were able to work with Hispanic LEP students by 
adapting and simplifying materials, e.g., with illustrations, note-taking, 
clarification of vocabulary, utilization of Spanish/English dictionaries, and 
identification of main concepts. 

UHO HAS SERVED? IN WHAT SUBJECTS? 

During school year 1985-86, 76 project LEP students were tutored by 43 tutors 
in eighteen subjects. 



Mathematics 

English 

Computers 

Science 

ESL 

Social Studies 



• Reading 

• Art 

• Government 

• Biology 

• World Geography 

• Algebra 



<i American History 

0 World History 

• Geography 

• Physical Science 

• Texas History 

• Earth Science 



Some of these students received tutoring in more than one subject. Thus, in a 
duplicated count, 122 students were tutored in subjects in the content areas 
of reading, language, mathematics, social studies, and science. (See Figure 3 
below.) 



SUBJECT 


GROUP 


FREQUENCY 


PERCENT 




Nontutored 


153 


90.533 


Reading 


Tutored 


16 


9.467 




Nontutored 


118 


69.822 


Language 


Tutored 


51 


30.178 




Nontutored 


i4y 


88.166 


Mathematics 


Tutored 


20 


11.834 


Social 


Nontutored 


151 


89.349 


Studies 


Tutored 


18 


10.651 




Nontutored 


152 


89.941 


Science 


Tutored 


17 


10.059 



Figure 3. BREAKDOWN OF 122 STUDENTS TUTORED 

(DUPLICATED COUNT) BY CONTENT AREAS. 
Frequency and percent of those tutored 
is compared to that of the nontutored. 
Total number of LEP students available 
to be tutored was 169. 
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HOM EFFECTIVE WAS THE TUTOR COMPONENT? 

The effectiveness of the tutor component was measured by student gains on the 
Language Assessment Battery LAB) and the Iowa Tests of Basic Skills/Tests of 
Achievement and Proficiency (ITBS/TAPl. :>KiMs/iests of 



iency (ITBS/TAP). 

LAB 



students showed statistically significant gains. However, tutored students 

fit .1 significantly more than nontutored students; the overall gains of 

one no?n°f jlntT^'l ^^^^^ed those of the nontutored by'slightly more^?han 

aS^n^JK^; flnT "Jh ''''?r''' ""^r" necessarily have greater 

gains than those with small amounts. 



RAW SCORE 
90 




Figure 4. 



Precast Mains 
Posttest Mans 



Tutortd Studtntt 



Nontutortit Studtnts 



COMPARISON OF LAB MEAN SCORES FOR TUTORED 
AND NONTUTORED STUDENTS FOR 1985-86. Gains 
of tutored students (N=58) exceeded those of 
nontutored (N=65) by slightly more than one 
point. 



ITBS/TAP 

IHh Zltn °lQr^"''S-^-.'i"^'"^' ^^'^ S"^es both spring. 1985 

and spring. 1986 was limited because: n» >^^^ 

- Many students enrolled in AISD in fall. 1985. and therefore had no 
scores for spring. 1985. 

— LEP A and B students are often exempted from taking the ITBS/TAP test 
because or limited knowledge of English. / r tc^t 

As can be seen in Figure 5. the number of tutored LEP students with test 
nSr^onf ^ "5 f^^^P^ language. Significance tests were therefore 

not done. In language, tutored students made mean gains of .96 grade 

1?6o1e Jelrs ^" ^ nontutored students made average gains of 

O 11 
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1985 


1986 


MEAN 


SUBJECT 


N 


MEAN 


MEAN 


GAIN 


TIT 


rORED 


Reading 


2 


3.95 


5.45 


1.50 


Language 


21 


4.80 


5.76 


.96 


Mathematics 


-T 

/ 


5.29 


7.04 


1.76* 


Soc. Studies 


4 


5.58 


8.05 


2.48* 


Science 


2 


7.40 


8.15 


.75 


NONTI 


JTORED 


Reading 


56 


4.96 


5.93 


.97 


Language 


36 


4.79 


6.39 


1.60 


Mathematics 


51 


6.29 


7.28 


.99 


Soc. Studies 


53 


5.07 


6.19 


1.12 


Science 


05 


6.90 


7.10 


.20 



Figure 5. ITBS/TAP GRADE EQUIVALENT (GE) GAINS 
FOR TUTORED AND NONTUTORED HISPANIC 
LEP A & 8 STUDENTS AT PROJECT 
SCHOOLS. Grades 7-12 combined except 
for science test (grade 9-12 only). 
Social studies is measured by Work 
Study Skills (ITBS) and Social 
Studies (TAP). 

* * Difference between means gains 
and reported total gain is due to 
rounding off. 



Several factors should be considered in interprating these results. 

• Many students scored at the chance level on both the pre- and 
posttests. Also, there was great variability in the size of gains made 
by individual students. 

• The best comparison group available was tutored vs. nontutored students. 
However, students were not randomly assigned to be tutored or not. It 
appears the lowest achievers were tutored. Therefore, groups are not 

as comparable as would be desired. 
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Changes in the tutor component might also enhance effectiveness. The proj^ram 
might consider setting requirements of a minimum lumber or minutes per 
individual tutoring session and/or a minimum numLdr of tutored times per 
project student. Some project LEP A and B students were omitted from the data 
analysis because they had received less than fifteen minutes of tuioring over 
the year. For these students the time spent was probably too short to be 
effective. The program may also want to strengthen the training provided to 
tutors in ESL instructional strategies, since most do not know Spanish. 
Finally, some nonproject students were also served by the tutors. Project 
students might receive more sarvice if this did not occur. 

Teacher Survey 

Along with the two objective measures of student achievement, teachers who had 
tutors were also asked about the effectiveness of the tutor component on the 
Jistrictwide Su vey in April, 1986. Thev were generally very positive about 
tutor impact. 

• Of the eight responding teachers, two-thirds (66.6%, N=6) indicated that 
students had greatly or somewhat improved their English skills as a 
result of working with Title VII tutors. However, two teachers said 
there was little improvement; one indicated that she/he saw no 
improvement. 

t Most of the teachers (88.8%, N=8) indicated that their students had 
improved in academiv; skills as a result of working witn tutors; one said 
that she/he saw little improvement. 

t Most of the teachers (77.7%, N=7) indicated that their stidents' 

attitudes toward learning had greatly or somewhat improve^J as a result 
of working with tutors; two said they saw little impruvenrient. 



CURRICULUM DEVaOPNENT 

WHAT IS THE CURRICULUM DEVaOPMENT COMPONENT? HOU EFFECTIVE WAS 11 ? 

The third component of AISD's Title VII program was in early stages in 
1985-86. All activities will be completed in three years. In this first year, 
evaluation consisted of checking on completion of pl^nr.ed activities. 
All were completed. 

t The Title VII Project purchased a resou; :c collection of multilevel 
content area materials for each of the four project schools. Books, 
kits, and computer software for social studies, math, science, practical 
life skills, language arts and ESL are included in the collections. 

0 Some teachers received the first part of the handbook which is in 
preparation— an annotated bibliography of multilevel instructional 
materials. 
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HOU EFFECTIVE WAS THE TITLE VII PROGRAM? 

The three program components were generally implemented as planned during the 
first year of the program, 1985-86. They were designed to impact the English 
language acquisition and academic skills of Hispanic project LEP A and B 
students. Although these achievement objectives were not met, they may have 
bten unrealistic criterion for a first year program just being implemented. 
Teachers are not yet fully trained, curriculum materials were placed at the 
schools late in the year, and all students were not tutored. 

There were some overall objectives that have not been discussed. Achievement 
and language proficiency objectives stated that 85% of the participants would 
show gains between pre- and posttesting on standardized tests. 

• LAB - This objective as stated was not met. Student test results were 

examined as a measure of English proficiency. Of the 131 LEP A 
and B students with pre- and posttest English LAB scores, 109 
(83.2%) made gains on the English LAB; 22 did not. To meet the 
objective, three more students would have needed to show gains. 

• ITBS - The objective as s:^ was not met. Students who had ITBS/TAP 

scores for both 1985 and 1986 were looked at in terms of percentile 
gains. The percentage showing gains in major test areas was: 



• La Prueba Riverside — The objectives as stated were not met. La Prueba 
Riverside was used as a measure of Spanish language proficiency 
and achievement gains. 



Reading 

Language 

Mathematics 



55% 
72% 
62% 



Social Studies 
Science 



57% 
25%*. 



*A science test is not given to junior high students as 
as part of the ITBS in AISD; therefore these scores could 
not be included in this data analysis. 



-Raw score gains of the students who had La Prueba 
Riverside pre- and posttest scores ai Murchison and Travis for 
1985-86 were examined by subject area. The percentage showing 
gains in raw scores was: 



Reading 

Language 

Mathematics 



58% 
58% 
64% 



Social Studies 
Science 



57% 
55%. 



It should be note that only 61-65 students had pre- and posttest 
scores in each test area. Most scores were well below the 40th 
percentile on both the pre- and posttests. 
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--However, significant overall gains were made by 
project LEP A&B students in all subtest areas as can be seen 
below: 



VARIABLE 


N 


MEAN 


SIGNIFICANCE 


Reading 


91 


1.14Z9 


.0106** 


Language 


92 


.9565 


0153* 


Mathematics 


93 


1.4301 


.0004** 


Social Studies 


92 


.8370 


.0494* 


Science 


92 


1.2174 


.0023** 



Figure 6. LA PRUEBA RIVERSIDE RAW SCORE MEAN GAINS. 
T-tests were run to check pre- to 
posttest gains for significance. 



* = Significance at the .05 level of 
probability 

** = Significance at the .01 level of 
probability 

It is interesting to note that when the schools were examined 
separately, Murchison project LEP students made significant 
gains in all areas except social studies. Students at Travis, 
however, did not make significant gains. This discrepancy may 
be influenced by the difference in programs at the two 
schools. At Murchison students are enrolled in an intensive 
Transitional Bilingual Education Program whereas students at 
Travis participated in a new ESL/content area support program 
(but receive no bilingual instruction). 
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Since the Title VII Program enhances existing bilingual programs at the project 
schools, it is difficult to separate program effects. Thii is particularly 
true at Murchison and Travis. Figure 7 below looks at gains over a two-year 
period for Hispanic LEP students. All were in the Transitional Bilingual 
Education, ESL, and/or Literacy program. Many were served by Title VII. 







1984 


1985 




Grade in 1985 


N 


Pretest 


Posttest 


Gain 


Reading 


22 


3.65 


5.11 


1.46 


7 Language 


16 


4.24 


5.67 


1.43 


Mathematics 


32 


5.81 


7.19 


1.38 


Reading 


9 


4.67 


5.64 


.97 


8 Language 


9 


4.66 


5.34 


.68 


Mathematics 


10 


6.66 


7.72 


1.06 






1985 


1985 




Grade in 1986 


N 


Pretest 


Posttest 


Gain 


Reading 


10 


3.74 


5.40 


1.66 


7 Language 


10 


3.78 


5.60 


1.82 


Mathematics 


10 


6.30 


7.95 


1.65 


Reading 


42 


4.76 


5.98 


1.22 


8 Language 


42 


4.67 


6.01 


1.34 


Mathematics 


42 


6.98 


7.76 


.78 



Figure 7. COMPARISON OF MURCHISON GRADE EQUIVALENT GAINS 
OVER TWO YEARS. Reading Total, Language Total, 
and Mathematics Computation scores on the ITBS 
were utilized. Two groups are reflected--those 
at Murchison in 1984-85 and those there in 1985-86. 



For those students able to be tested for two years in a row: 

• Both groups generally showed gains exceeding one GE year (the national 
i 'v/age) In all three ireos (9 of 12 conparisnn:?). Exceptions were 
i;;ade 8 1984-85 reading anC language and grade 8 1985-86 fnathematics 
computation. Gains exceeding one GE help these students close the gap 
between their performance and the national average. 

t Seventh and eighth graders In 1985-86 showed greater gains than those 
in the saae grade in 1984-85 in 5 of 6 coMparisons. Differences ranged 
from .2 to .66 of a GE year. The one exception was grade 8 mathematics, 
in which ':ase the 1984-85 students gained 1.06 GE year compared to .78 
of a year for the 1985-86 group. 
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• Most of those in grade 8 this year attended Murchison last year as 
7th graders. These students continue to make strong growth this 
year, although it is not quite as strong as last year. The one weak 
area was mathematics computation, with a gain of .78 this year 
compared to 1.38 last year. However, it should be noted that the 
bilingual mathematics teacher left during the 1985-86 school year, 
and several substitute teachers were hired until a long-term 
substitute stayed for the remainder of the year. 

• Both groups renal ned below the national average except in 
natheoatics conputation for the 1985-86 7th graders. Mathematics 
computation scores were the highest overall. Students were furthest 
below the national average in reading at grade 8 in 1984-85 (3.16). 

Overall, the Murchison Program appears quite successful with most 
Spanish-dominant students who can be tested. 

At Travis, the Title VII program was not the only new language assistance 
program implemented during school year 1985-86. Hispanic LEP A and B students 
we- •* also able to take advantage of the Sheltered Bilingual (enchanced ESL) 
Program. 

Only 14 students had ITBS or TAP scores from both 1985-86 and 1984-85 (about 
56 students participated). Many were new to AISD this year and some who were 
not new could not understand English well enough to be tested last year and/or 
this year. 

For those students tested in 1985-86 and 1984-85: 

0 About half demonstrated gains of 1 GE year or more in each test area. 

f Student achievement is still below the national average in all grade 
and subject areas. 

Overall, the bilingual/ESL services appear to be impacting student gains at 
Hyrchison and Travis. 



Reference 

Yonan, B. & Schuyler, N. TITLE VII: 1985-86 final technical report . 

Austin, Texas: Office of Research and Evaluation (Pub. No. b6.25), 
Austin Independent School District, February, 1987. 
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LANGUAGE ASSESSMENT BATTERY 



Purpose 

The Language Assessment Battery (LAB) is administered in English to provide a 
means of determining the English proficiency of secondary pupils for whom 
English is not the primary language spoken. The LAB was used to provide 
information concerning: 

Decision Question Dl ; Should the Title VII program be continued as it 
IS, modified, or discontinued? 

Evaluation Question Dl-1 . Do project participants exhibit 
significant gains in their English language proficiency? 

Eval ua 1 1 on Ques 1 1 on Dl - 5 « How do the English proficiency and 
achievement gains ot students receiving tutoring compare to 
students who were not tutored? 

Information Weed 12 . Did the project meet its objectives? 



Procedure 

The LAB was administered to all project participants (LEP A & B students) 
between October 15 and November 22, 1985, to provide a baseline for comparison 
with results from the April and May of 1986 re-evaluation. At Murchison the 
TBE teachers administered the group segment of the test while the individual 
part was given by the project specialist and Office of Research and Evaluation 
staff members. At Travis and Anderson, the project specialist and LPAC 
chairperson (LEP coordinator) administered both the group and individual parts. 

The late pretest at Murchison (ending November 22, 1985) was due to the 
unexpected increase in the number of LEP students who needed to be tested. 

From April 25 to May 12, 1986, the posttest was administered using the same 
personnel for testing at the four schools. 

LAB scores were entered on a computer screen by the clerk for bilingual 
programs. The programmer analyst wrote a program and transferred the pretest 
scores to a Statistical Analysis System (SAS) data file tape in March of 1986. 
Posttest scores were entered and merged with the original SAS data file in May 
of 1986 (SA-BYOOl-0102). The percentage of student gains were hand tabulated 
from the merged SAS program in November, 1986. The programmer ran a SAS PROC 
MEANS (SA-BY002-0301) to analyze the gains for significance, overall and by 
grade (7-12). (See Attachment A-1.) 
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Results 

Evaluation Question Dl-1 ; Do project participants exhibit significant gains 
In their English Language proficiency? 

As can be seen in Figure A-1, overall the students at the four project schools 
made highly significant gains. When looked at by schools, two thirds had 
significant gains (.05 or greater). (See Attachment A-1, pp. 06 & 20.) 



STUOfNTS Mt TUIUXED 



VMIABLE 


N 


X£A.i 


STANOAAO 
OEVUriCN 


NiNINUN 
VALUE 


NAXINUN 
VALUE 


SrO EKKOK 
W NEAN 


C.V. 


7 




MCENG 
rOSfENC 


9t 
91 


49.1441 

^♦.i724 


12.4201 
14.4220 
9.]2i4 


1*«0000 
21.0000 

_^i3.oaqo ^ 


*4.0000 
72.0000 
^21 « 0000 


l.*30l 
1.1937 

, ..1.2249. .. 


33.1*1 
31.4)1 
101.703 


22.49 
24.21 


o.oaci 
o.oa^i 
a.oaai 










sruoENTS htn not 


TUrORCO 








II 


NEAM 


STA/IOMO 

ocvuriaM 


NININUN 
VALUE 


~NAXINUN 
VALUE 


$to*e'h«m 

Of NCAN 


C.V." 


T 


rN> 1 n 


' 'fUEENC' * 
fOSTENG 


«9 
. «S 


4«.74«i *" 
94.9319 
.. . 1.1*92 _ 


I?;994i** 
19.9932 
•.919* 


2 f. 0000* 
24*0000 
•^22.0000 


'"73.0000 
12.0000 
30.0000 


1.9TI9 
1.9291 
1.1149 


34.114 
21.310 
109.990 


23.*3 
21.41 

. 7.33 


0.0001 
0.0001 
0.0001 



Figure A-1. SIGNIFICANT OVERALL RAW SCORE GAINS OF TUTORED AND NONTUTORED 
PROJECT LEP A AND B STUDENTS. The highest score that can be 
earned on the LAB is 92. 



Evaluation Question Dl-1 ; How do the English proficiency and achievement 
gains ot stuaents receiving tutoring compare to students who were not tutored 
(Johnston and Murchison experimental versus control groups)? 

During the spring semester of 1986, tutors were also assisting students at 
Anderson High School. Thus, Anderson was also compared with a control group. 
At all three schools (Travis was excluded) control groups consisted of 
nontutored project A & 8 students. All those tutored at the schools were 
considered the treatment subjects, and all those not tutored were the controls. 

A SAS program was run (SA-BY002-0301) to compare tutored students with their 
nontutored cohorts overall, by school, and by grade. This SAS program also 
included a SAS PROC MEANS to check the significance of the gains of each group. 

As can be seen from Attachment A-1, page 4 and page 18 and Figure A-2 on the 
following page, overall the gains of the tutored students (9.14 points) 
exceeded those of the nontutored (8.17) by slightly more th^an one point. This 
difference between the groups was examined for significance; the programmer 
analyst ran a PROC SORESPOT (SA-BY002-0501) program of regression analysis and 
F tests (SA-JF065-0601-X). No statistical significance was found. (See 
Attachment A-2 & A-3.) Moreover, those who received more tutoring did not 
necessarily have the greatest gains. (See Attachment A-1, pp.04 to pp.18.) 
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Figure A-2. COMPARISON OF LAB MEAN SCORES FOR 



TUTORED AND NONTUTORED STUDENTS FOR 
1935-86. Gains of tutored students 
(N=58) exceeded those of nontutored 
(N=65) by slightly more than one 



point. 



An important consideration is the newness of the program at all sch'^^ols and 
the limited time tutoring was provided. It began in October, 1986, at two 
schools, Murchison and Johnston. During the second semester, tutoring was 
expanded to Anderson. University of Texas multicultural class students 
assisted project students at the original schools for a maximum of 5 to 5 1/2 
months (allowing for'training, finals, and winter/spring vacations). During 
the first semester tutoring assistance was given between October and mid 
December; second semester tutoring began the first week in February and ended 
mid May. The time tutored per LEP student ranged from 5 minutes to 21 1/2 
hour. 

The fact that the program was new meant teachers had to determine how to use 
the tutors most effectively. Some changes in teachers and students involved 
occurred. Subsequently, it is possible that the achievement of Title VII 
students has not yet been fully impacted. 

For a more complete account of the tutor component, see Appendix G. 

Inforaation Keed 12 : Did the project meet its objectives? 

By the end of project year 1985-86, 85% of project participants who are in 
attendance 90% of the time will exhibit gains in scores from pretesting to 
posttesting using the English Language Assessment Battery. (Objective) 

This objective as stated was not met. It should be noted that rather than 
check percentage attendance, only those present for pre- and posttesting were 
included. A check last spring showed these students had very high attendance 
rates. Thus, of the 131 LEP A and B students with pre-- and posttest English 
LAB scores» 109 (83.2X) made gains on the English LAB; 22 did not. To meet 
the objective, three more students would have needed to show gains. 
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Discussion 

Although very significant overall gains are being made by project students in 
terms of English language acquisition, the project objective as stated has not 
been met; it should be noted, however, that if 3 more students had made gains 
the objective would have been met. It may be that the 85% criterion for 
meeting the objective is unrealistic in light of the first year implementation 
of the program. Also, although both the tutored and control groups are making 
very significant overall group gains, the gains in favor of the tutored group 
were very modest, slightly more than 1 raw score point which was not 
statistically significant. 
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S A S LOG VSE SAS 82.4 



VSE 3.1 JOB EVISASBY 



13:09 FRfOAYf 0ECEH8ER 12, 1966 
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NOTE: THE JOB £Vl$ASfiY HAS BEEN RUN UNOEft RELEASE d2«4» UP SAS 
AT AUSTIN INOEP£NOENT SCHOOL DISTRICT (01986001). 

NOTE: CPUIO VERSION «. FF SERIAL « 013553 MODEL « 43^1 • 

note: NU OPTIONS SPECIFIED. 
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OPTIONS ERRORS » 0; 
TITLE TITLE VII PROGRAM 
TITLE2 PRUE8A - FALL 1985 
TITLE3 TUTOT DATA SET 

DATA 8AR8FIL1; 



SA-BY002 0301; 
LA6-FALL85 LAB-SPKING 86 



8Y001 0102; 
8Y001 0105; 



INPUT FILEIO S 1-3 

STUIO . S 4-10 

STUNAHE S 11-30 

GRADE S 31-32 

SCHOOL S 33-35 

READ 36-37 

LANG 38-39 

MATH 40-41 

COMP 42-43 

SOCST 44-45 

SC 46-47 

COMPREH 48-50 

V0CA8 51-53 

KORKSTU 54-56 

a57 PREENG ZDZ. 

£59 POSTENo 202. 

d6l PRE SPAN 202. 

«63 POSTSPAN 202.; 
IF SCHUuL » •003* OR SCHOOL = 

if prekng gt 0 and posteng gt 

labgain a posteng - pkeeng; 

keep stuid schuol grade preeng 
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o; 
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NUTE: INVALID OATA FOR POSTENG IN L&NE 31 59-60. 23:31 
NuTE: INVALID DATA FOR PCSTSPAN IN LINE 31 63-o4. 25:Jl 
NOrt: FURTHER ERRORS OF THIS TYPE WILL NOT Bfc PRINTED. 
OPTIONS ERRORS^NN; ♦ LIMIT REACHED. 
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VQCAB»* kORKSTUa* PREENG»83 POSTENG* ♦.ci*RESPAN»90 POSTSPAN^. LABGAIN*. _£RR0R^*1 ^N_*l 
NOTE; DATA SET USER010.8AR8F ILl HAS(ji2.'0BSERVATI0NS AND 6 VARIABLES. 198 OBS/TRK. . 
NOTE: THE DATA STATEMENT USkD 7.47 SEOlNDS AND 330K. 
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KEEP STUID TUTTOTAL; 
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NOTE: INVALID DATA FOR TUTREAD IN LINE 273 40-43. 260:31 

NOTE: INVALID DATA fOR TtTLANG IN LINE 273 45«48. 261:31 

NOTE: INVALID DAfA FOR TUTMATH IN LINE 273 50-53^ 262:31 

NOTE: : VALID DATA FCR TUTSOCST IN LINE 273 55«58. 263:31 

NiiTe .VALID DATA FOR TUTSCI IN LINE 273 60«63. 264:31 

NOTE. FURTHER ERRORS Or THIS TYPE WILL NOT^BE PRINTED., 
OPTIONS ERR0RS«NN; ♦ LIMIT REACHED. 



RULE: 



1234567 10U^4567 201234567 301234567 401234567 501234567 601234567 701234567 80 



273 3 09 1957321 OELEON HARTA 

SCHO0L«3 (»RADE«09 STUlO* 1957321 STUN AHE*DELEUN HARTA SEMESTER* TUTREAD^ 
TUTTOTAL»0 .ERROR.«l .N^»l 

NOTE: DATA SET USEROlO .BARQF IL2 HAS^.ST OBSERVATIONS AND 2 VARIABLiiS. 420 OBS/TRK. 
NOTE: THE DATA STATEMENT USED 5«7l SivONDS AND 306K. 



OOOOOOlO 

TUTLANG** IUTMATH«* TUTSOCST=. TUTSCI= 
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; 

PROC SORT; 
BY STUilO; 
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warning: sortsize value is less than the minimum 

required dy your system sort utility* 

the sort utility may t erhinate^ abnormally, 
note: uata set user0l9.barbfil2 has 167 observations and 2 variablbso 420 obs/tkk^ 
note: the procedure sort used u.24'^ec0nds and 292k. 
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DATA BARBFILl; 

MERGE BARBFILl 

BARBFIL2; 
BY STUlO; 



( IN » INFILl) 
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S A S LOG VSE SAS 62.^ 



VSE 3*1 JOB EVISASSY 
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IF INFILl;^ -- 

TUTGROUP « •OZERO HOURS*; 
IF TUTTOTAL GT 0 AND TUTTOTAi LT 2 



IF TUTTOTAL GE 2 
IF TUTTOTAL GE 8 



AND TUTTOTAL LT 8 



THEN TUTGROUP 
THEN TUTGROUP 
THEN TUTGROUP 



•IGT 
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= 'iGE 8 



LT 2«; 
LT 8«; 



note: data set USEROIO.BARBFILI HAS 123 ^OBSfcR VAT IONS AND 8 VARIABLES. 134 OBS/IRK. 
note: THE DATA STATEMENT USED 4.30 SECONDS AND 306K. 
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NOTE: OATA SET .USER01O.BARBFIL2 HAS 58 OBSERVATIONS AND 8 VARIABLES. 134 OBS/TRK 

NOTE: THE PROCEDURE SORT USED 13.02 SECONDS AND 292K. ^'^'^^'^^^ ti. 134 OBS/TRK,^ 
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32 
lERXC 



GRADE* 12 — 



PREENG 1 _ 33.0000 • 33.0000 .33.0000 

POSTENG 1 61.0000 . 61.0000 61.0000 

LABGAIN 1 28.0000 . 28.0000 28.0000 

NDTt:: THE PROCEDURE MEANS USED 2.50 SECONDS ANO 34dK AND PRINTED PAGE 3. 
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NARNINGX SORT SIZE VALUE IS LESS THAN THE MINIMUM 
REQUIRED BY YOUR. SYSTEM SORT UTILITY. 



00001050 
00001060 



33 



THE SORT UTILITY MAY TERMINATE ABNORMALLY. 

4iSett0l0ne4<>qP'A^ <ft OaSgftVATIO NS A NQ B VARIABLES. 134 OBS/TRK. 



NOTEI IHE PROCEOUag SORT USED 10.86 SECONDS Am 
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STUOEKTS WERE TUTOHEO 
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PREENG 1 *7.2857 . . 15.0965 . 23.0000 64#0000 5*7059 3U926 8*29 0*0002 

PDSTENG 7 53.0000 12.7279 34»«0000 66.0000 2^.015 I U02 O.OOOl 

LABGAIN 7 5.7U3 16.1009 -13.0000 28.0000 6.0656 281.765 C.9^ 0.38^0 



■ ■■ SCHU0L«009 ■ ~ — ■ ■ I 
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SCH00L»052 



PREENG 46 _ _ 34.3913L. 11.3402 16.0000 61.0000 

POSTENG 46 43.6522 14.3406 21.0000 72.0000 

LA8GAIN 46 9.2609 6.38S7 -9.0000 24.0000 

note: THE PROCEUURE MEANS USED 2. 48_ SECONDS, AND_ 348K ANO PRINTED PAGE 4. 
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pROC tabulate; 

CLASS. SCH0PL_ TUTGROUP?^ 
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STUDENTS WERE TUTORED 



SCHOOL 009 



I 



I ... PREENG „ 



N 1 HEAN 



POSTENG. 



.J 



I HEAN I 



_LA8GAIN I 

N I MEAN I 



1— ^ 

ITUT6K0UP 

1— — — — 




1 


1 
1 

11 


1 
1 

. 49.001 


1 

1 

11 


1 i 
1 1 

68^001 1{ 


1 
1 
1 

19.001 
15.001 


IIGT 0 . LT 2 
1— — — - 




— 1 
J 


i2GE 2 LT 8 




1 


11 


30.00J 


11 


45.001 11 


1— — rr ?r 

I3GE 8 

1— — — — 




1 


31 


45.001 


31 


55.'67| 31 


10.671 
13.^0I_ 


i TOTAL 




1 


51 


42.801 


51 


_56.00| 5| 



4a» O 



3cr 



3~J 




PRUEBA - f All^tlfl?" ^'^aa'^ca. . SA-BYOOa 0301 13J09 FRIDAY, DECEMBER 12. 1986 

TiJTn? hTta ccT^ " LAB-FALL85 tAB- SPRING 86 BYOOl 0102 
jrUTOT DATA SET .BYOOl 0105 



STUDF^>TS WERE TUTORED 



SCKCOL 052 



ITUTGROUP 



Itai 0 LT 2 



^GE 2 tr 8 



I3GE a 
I TOTAL 



PREENG 



N 



j -^POSTENG I tABGAIN | 

Hf^llL- ' ^ ' ^^^^ ' ^ I hean "! 

I 1 I I 1 1 



,24 1 38> 08| __... 24| 47.38| 24| 



171 2. .591 



51 36.401 
». 



I7i 36.291 



51 50.b0| 



9.291 

1 

7.711 

TTTTrl 

51 U.40i 



171 



|_ . 34.391 461 43.651 >6|__?.2_6| 



00 



ro 



I— » m 

o 
I— ♦ 

X 



41 



--4-9- 



PRUEBA - FA^/ lQfl5 cAMfli: SA-BV002 0301 13S09 FRIOAV, 0ECEM8ER 12 

T..Tn? nTr.^crT^'®^ LA8-FALL85 LA8-SPRING 86 BVOOl 0102 

.TUrOT DATA SET _ BVOOl .0105 

STUDENTS WERE TUTORED 



TOTAL 



j j ^"NG 1 POSTENG |. ._LABGAIN "_1 

{ i N I MEAN I N I MEAN | N | MEAN | 

{!-"!°^°"^. ]j ""p ; ; ; — ; 

I ICT 0. LT 2 I . 25 j 38.52 1 '^^L^'^^^"' " 

^ '•^ ° ' 191 30.531*" 191 38.211 7.ls\ 

1 _ - - I - ■♦—--^♦■.........^♦^.^^^ 

jf^fj ^ • 1*1 Ul 52.001 Kl ro.29r 

jTOT AL . I . 36.671 . . 5Ul -*5.84| 58]. _.9. 17L 

THE PROCEDURE TABULATE USED 4.80 SECONDS AND 590K AND PRINTED PAGES 5 1 u'si. 

PROC TABULATE r 

CLASS GRADE TUTGR0UP5 nnnnJfl" 

VAR.PREENG POSTENG LABGAINi - ... . _ „ _ OOOOllSo 

00001200 



TABLE GRADE ALL, TUTGROUP ALL, 00001200 
JPREENG POSTENG LA8GAINJ*<N»F-7.'mEAN»F-7.2) ; 00001210 
KEVLABEL ALL « .TOTAL'! .... oTollllo 

00001230 
0000U40 



00 



PKUPBA . FAlV^\Ls^' ''I^Aa'^c!!. . oc . FRIDAY, DECEMBER 12. 1986 

TMTn? oTt! c^,^^®^ LA8-FAU85 UB-SPRING 86 BYOOl 0102 
lUIUT.OATA StT ... _. BYOOl 0105 

STUDENTS hERE TUTORED 



GRACE 07 




44 



ERIC 



.O..CO. eJf^'rLc" SA-By002 0301 13:09 FRiOAV, 0ECEM6ER 12, 1986 10 

PRUEBA - FALL 1985 LAa-fALL85 LAB-SPRING 86 BYOOl 0102 

_T.uTOT_OArA..sET. erooi oios 



ro 



3> 
no 

CD o 
X 
3> 



STUDENTS MERE TUTOREO 



GRACE 08 



^« I- 



ITUTGROUP 
1- 



PREENC J 



POSrENG 



I tA8GAIN_ 



MEAN 



I- 



i2GE 2 LT 8 



I3GE 8 



.131 40.8^1 



71 34.571 



I TOTAL 



21 49.001 



I _ .221 39.591 



! MEAN I 



N 



MEAN 



I 



I 



131 45.851 . .. 131 . 5.001 

71 44.43 1 71 9.861 

21 7U0b| 21' 22.001 

221 47.681 221. .8.091 



4^ 




e 
e 

€ 



TITLE VII PROGRAH 
PRUEBA - FALL 1985 LAB<-fALL85 
TurOT DATA SET ... 



SA-BYOOZ 0301 13s09 FRIDAY. DECEMBER 12. 1986 11 

LAB*SPRING 86 6Y001 0102 

BYOOl 0105 - - 



00 



ro 



STUDENTS WERE TUTORED 



GRACE 09 



PREENG 



TUTGROUP 



IGT 0 LT 2 



2GE 2 LT 8 



3GE 8 



TOTAL 



I 

I . 



MEAN 



J 
I 

Li 

11 



I 

I 

I 
I 

^9.001 

30.001 
■ ■ 



51 
71 



^3.201 
^2.U| 



POSTENG 



LABGAIN 



I 

I 

I 

li 

II 

"*5| 



MEAN 



! 

I 
I 

68.001 

m^mm 

^5.001 
50.201 



N I MEAN I 



I 
I 

II 
II 
51 



I 

I 

19.001 

15.001 
•I 
7.001 
•I 



71 52.001 _7| 9.861 



48 




_luiLi_UAiA_5tf BY001.0I05 



STUDENTS UERE TUTORED 



00 



ro 
o 




X 

> 



or 



fcERJC 



50 




1ITLE VII PROGRAM 
PRUEBA - FALL 1985 LAB-FALL85 
TUrOT DATA ^ 



SA-BY002 0301 13X09 FRIDAY • DECEMBER I2t 1986 13 

LAB-SPRING 86 BYOOl 0102 

. BYOOl 0105_. . 



00 



ro 
cn 



GRACE 11 



ITUIGROUP 



I3GE 8. 



I TOTAL 



STUDENTS WERE TUTOREU 



PKEENG 



POSTENG 



LABGAIN 



N I MEAN 



I 
I 

11 



i 
I 

50.001 



II 50.001 



I MEAN I 



I 
I 

II 

II 59.001 



59.001 



j KcAN 



I 
I 

II 
II 



9.001 



9.001 



-a 

ro m 

»— I 

X 

> 



52 



53 



~ evooi .0105 

;tuoents nere tutoreo 



00 

in' 



GRADE 12 



TUTGROUP 



3GE.8 



TOTAL 



-> 



{ — ''RE tNG J . POSrENG 

) N j MEftN | ~ I MEAN i 

__.! j I" I I 

• ^ i I 



J.A8GAIN. 



1 



~| i|_33,00J 

1 11 33.001 



i HE AN 



li .61.00 1 ^ ^28.00 
II 6U00I II 28*00 



9 



9 



54 



_5i. 



> 
m 



TITLE VII PROGRAM 
PRUEBA - FALL 1985 LAB-FALL85 
TUTOT DATA SET. _ . . 



SA-BY002 0301 13:09 FRIDAY* DECEMBER 12f 

LAB-SPRING 86 BYOOl 0102 

6Y001 0105 . . 



1986 15 



00 



ro 



STUDENTS MERE TUTORED 



TOTAL 



iTUTGROUP 
I- 



IIGT 0 LT 2^ 
I- 



i2G£ 2 LT 8 
I- 



I3GE 8 
I- 




FCSTENG. I LABGAIN 
N I MEAN I N t MEAN 



J TOT At. 



I i 

I I 

251 ^8.201 



191 38.211 

Ut ^U7l| Ul 52.001 
581 36.67i 



I 
I 

251 9.68 

191 7.68 

Ut 10.29 



581.. -»5.8.4| 58l._ . 9.171 



note: the PROCED' RE TABULATE USED 6.05 SECONDS AND 592K AND PRINTED PAGES 9 TO 15. 



495 
496 
497 _ 
498 
499 

NOTEt 
NOTE: 



OATA BARBFIL2; 

SET BARBFlLi; 

IF_ TUTGROUP * *OZERO HOURS'; 
^TITLE4 • 
TITLE5 STUDENTS MERE MOT TUTORED; 



00001250 
00001260 
00001270 
00001280 
00001290 
00001300 



OATA SET USERU10.BARBFIL2 HAS 65 OBSERVATIONS AND 8 VARIABLES* 134 OBS/TRK. 
THE DATA STATEMENT USED 2.87 SECONOS AND 306K. _ 



501 

!>02 
503 



PROC MEANS MAXDEC»4 N MEAN STO MIN MAX STDERR CV T 
VAR PREENG POSTENG LABGAINJ ..... 



PRTl 



00001310 
00001320 
00001330 



57 



56 



TITLE VII PROGRAM SA-aY002 0301 13:09 FRIOAY, OECEMBER 12. ih 

?f.V^?\:T^^^^r^^®5 LA8.FAU85 LAB-SPRING 86 BYOOl 0102 ' ^^^'^ 

TUTOT DATA SET .. . 8^001 0105 



STUDENTS WERE NOT TUTOREO 



VARIABLE 



PREEN6 

P0STEN6 

LA80AIN 



65 
65 
65 



HEAN 



46.7692 
5^.9385 
8.1692 



STANOARO 
OEVIATION 

15.9548 
15.5532 
8.9854 



MINIMUM 
VALUE 

2U0000 
24.0000 
•22.0000 



MAXIMUM 
VALUE 

73.0000 
82.0000 
30.0000 



N0TE5 THE PROCEDURE MEANS USED 5.37 SECONDS AND 348K AND PRINTED PAGE 16. 

504 PROC SORT; 

505 BV GRADE; ' 

WARNING: S0RTSI2E VALUE iS LESS THAN THE MINIMUM 

REQUIRED By VOUR SYSTEM SORT UTILITY. 
..^Tc r...^^^ ^^^^ UTILITY MAY TERMINATE ABNOHMALLY. 

.2;!* 5^1^ USER010.flARBFIL2 HAS 65 OBSERVATIONS AND 8 VARIABLES. 134 QBS/TRK, 

NOTE! THE PROCEDURE SORT USED 10.98 SECONDS AND 292K. OBS/TRK, 



STO ERROR 
OF MEAN 

U9789 
1.9291 
1.1145 



00001340 
00001350 



C. V. 



34.114 
28.310 
109.990 



PR>|T1 



23.63 0.0001 
28.48 0.0001 
7.33 0.0001 



506 
507 



3> 

ro m 
o 



60 




TiriE VI : PROGRAM 
PRUE8A - FALL 1985 LA8«FALL85 
TUTOt DATA SET 



SA-8Y002 0301 13:09 FRlOAY> 0ECEH8ER 12« 1986 17 
LA8-SPRING 86 8Y001 0102 
evOOl 0105 _ _ _ _ 



STUOENTS WFHE NOT TUTORED 



VARIA8LE 



MEAN 



ST AN OAR 0 
DEVIATION 



MINIMUM 
VALUE 



MAXIMUM 
VALUE 



STO ERROR 
OF MEAN 



C. V. 



PR>1T| 



"OOr- 

a* 
ro 

.iJ3 



GRA0E»07 



PREENG_. 
POSTENG 
LA8GAIN 



18 
18 
18 



39.2778 
45.9^44 
6.6667 



15.8849 
15.3947 
9.2609 



.21.0000 
24.0000 
-22.0000 



68.0000 
78.0000 
21.0000 



._3.7441 
3.6286 
2.1828 



__40.442 
33.507 
138.914 



1C.49 
12.66 
3.05 



.0.0001 
0.0001 
0.0072 



GRA0E>08 



.PREENG 
POSTENG 
LA8GAIN 



39 
39 
39 



48.6154 
56.9231 
8.3077 



i4.6514 
14.0082 
9.0267 



23.0000 
26.0000 
•13.0000 



„_ 73.0000 
82.0000 
30.0000 



.^•3461 
2.2431 
1.4454 



_ 30.137 
24.609 
108.655 



2C.72 
25«38 
5.75 



.0.0001^ 
0.0001 
0.0001 



PAEENG 

POSTENG 

LA8GAIN 



2 
2 
2 



.45.0000 
61.0000 
16.0000 



29.6985 
21.2132 
8.4853 



GRA0E»09 

24.0000 
46.0000 
10.0000 



66.0000 
76.0000 
22.0000 



.j21.0000 
15.0000 
6.0000 



65.997 
34.776 
53.033 



,2.14 
4.07 
2.67 



0.2780 
0.1535 
0.2284 



GRACE* 10 



PREENG 

POSTENG 

LA8GAIN 



52.3333 
58.6667 
6.3333 



21. 1266 
16.5025 
11.5902 



28.0000 
42.0000 
•7.0000 



66.0000 
75.0000 
14.0000 



J2.1974 
9.5277 
6.6916 



„40.369 
28.129 
183.004 



GRA0E>11 



PREENG 

POSTENG 

LABG4IN 



2 
2 
2 



64.0000 
74.5000 
10.5000 



1.4142 
4.9497 
6.3640 



63.0000 
71.0000 
6.0000 



65.0000 
78.0000 
15.0000 



1.0000 
3.5000 
4.5000 



. 2.210 
6.644 

60^609 



4.29 
6.16 
G.95 



64.00 
21.29 
2.33 



0.0503 
0.0254 
0.4438 



0.0099 
0.0299 
0.2578 



GHA0E>X2 



PREENG 1 
POSTE/^G 1 
LA8GAIN I 
NOT£: THE PROCEDURE 



62.0000 • 62.0000 62.0000 

77.0000 . 77.0000 77.0000 

15.0000 « 15.0000 15.0000 

MEANS USED 2.06 SECONDS AND 348K ANO PRINTED PAGE 17. 



510 PROC SORT; 

511 Bv school; 

warning: SORTSIZE value is less THAN THE MINIMUM 

REQUIRED 8Y YOUR SYSTEM SORT UTILITY. 

THE SORT UTILITY MAY TERMINATE ABNORMALLY. 
NOTE: DATA SET USERD 1D.BAR8F IL2 HAS 65 08SERVATI0NS ANO 8 VARIA8LES. 134 OBS/TRK, 
NOTE: THE PROCEDURE SORT USED 13.64 SECONDS ANO 292K. 



00001400 
00001410 



61 



512 
513 
"514 



PROC MEA1IS MAXDEC«4 H MEAN STO MIN MAX STOERR CV T PR. < 

VAH PREENG POSTENG LA8GAIN: 

•Y SCHdOU " ■ - 



00001420 
00001430 
00001440 



VARIABLE 



riTLE Vn PROGRAM SA-BY002 0301 13x09 FRIO/Y, DECEMBER I2f 1986 IB 
PRUE0A « FALL 1985 LAB«FALLB5 LAB-SPRING 86 BYOOl 0102 
. . TUTOT.OATA SEf - ^^^^^ 0^05 - - -- 



MEAN 



STUDENTS WERE NOT TUTORED 



'standard 
deviation 



MINIMUM 
VALUE 



MAXIMUM 
VALUE 



STO ERROR 
OF MEAN 



C.V« 



PR>|T| 



PREENG 

POSTENa 

LABGAIN 



5 
5 
5 



6^.6000. 
71.8000 
7.2000 



1«5166 
7.5961 
B.5849 



SCHOOL «003 



63.0000 
59.0000 
-7.0000 



66.0000 
78.0000 
15.0000 



0.6782 
3.3971 
3.8393 



2.3^8 
10.579 
119.23^ 



95.25 0.0001 
21.1^ 0.0001 
1.B8 0.134^0 



SCM00L«009 



PREENG 

POSTENG 

LABGAIN 



3 
3 
3 



38.0000__ 
55 DODO 
17.0000 



20.8806 
19.1572 
4.3589 



24.0000 
42.0000 
14.0000 



62.0000 
77.0000 
22.0000 



SCHO0L«052 



PREENG 57 45.6667 15.5384^ 21.0000 73.0000 

POSTENG 57'" "' 53.4561 15.2187" 24.0000 82.0000 

LABGAIN 57 7.7895 9.0509 -22.0000 30.0000 

N0TE5 THE PROCEDURE MEANS USED 1.92 JECONDS AND _348K AND PRINTED PAGE 18. 



I' 

1 . 



516 
517 
518 
519 

519" 
520 
521 
521 



PROC TABULATE; 

CLASS SCHOOL TUTCROUP:_ . 
' ' VAR PREENG POSTENG LABGAINS 



12.0554 
11.0604 
2.5166 



2.0581 
2.0158 
1.1988 



54.949 
34.831 
25.641 



34.026 
28.470 
116.194 



00001460 
00001470 
00001480 
00001490 



TABLE SCHOOL ALL, TUTGROUP ALL, 

IPREENG POSTENG LABGAIN)*(N*F*7. MEAN»F=7.2I; 

K£YrABEL~'ALL'«~'TdfAL»T 



00001490 
00001500 
00001510 
00001510 



3.15 0.0876 
4.97 0.0381 
6.76 0.0212 



22.19 O.OOOl 
26.52" 0.0001 
6.50 0.0001 



6. 



62 



nTLE VII PROGRAM $A«BY002 0301 13:09 FRIDAY* OECEHBER 12« 1986 19 
PRUEBA ^ FALL 1985 LAB«FALL8$ LAB-SPRING 86 BYOOl 0102 
TUTOT DATA SET BYOOl 0105 _ 



00 

ro 
tn 



STUDENTS WERE NOT TUTORED 



SCHOOL 003 



TUTGROUP 



JOZERO HOURS 
TOTAL 




3a 



64 



65" 




66 



- / 

1> 



TITLE VII PROGRAM 
PRUEBA • fALL 1985 LAB-FAUd5 
^ .TUTOT.OATA $ET .... 



SA«BY002 0301 13:09 FRlOAYt DECEMBER 12f 1986 

LAB^SPRlNG 86 BYOOl 01C2 

. .__ BYOOl OIOp . . 



21 



00 



SCHOOL 052 



STUUENTS iiERE NOT TJTOREO 





1 
1 


PREENG .,.1 


PQSTENG 1 


__.LABGAIN* 1 




N i MEAN 1 


H 1 MEAN 1 


H 1 M£AN i 


ITUTGROUP 


1 


i 1 


i i 
1 1 
571 53.46i 


i 1 
1 1 


lOZERO HOURS 


1 


1 1 
57! ^5.671 


571 7.791 


(TOTAL 


1 


571 45.67i 


571 53.461 


571 7.791 



> 




TITLE VII PROGRAM 
PRUEBA « FALL 1985 tAB«FALL85 
. TUTOT DATA SET 



SA-BYOOZ 0301 i3s09 FRIDAY, DECEMBER 

LAB-SPRING 86 bYOOl 0102 

BY00l_0l05 



12, 1986 



22 



STUOENTS WERE NDT TUTORED 



TDTAL 



PREENG 



POSTENG 



MEAN 



ITUTGROUP 



lOZERC HOURS 
I TOTAL 



I 



I 



651 ^6.77i 
65i 46.77i 




631 -54.941 



651 54.941 



8.171 



"nOTE:""tH£ PROCEDURE TABULATE USED 4.81 SECONDS ANO 590K AND PRINTED PAGES 19 10 22. 



> 
m 

•—I 
X 

> 



5?2 
523 
524 

_525 

525 
526 
527 
527 
52B 



PftOC TABULATE; 

CLASS GRADE TUTGROUP; 
VAA PREENG POSTENG LABGA!N; 



GRADE ALLt TUTGRDUP ALL t 

(PREENG POSTENG LABGAIN)*CN*F»7. MEAN*F«7.2lt 



TABLE 

KEYLABEL ALL ' 'TOTAL*; 



J)0001520^ 
00001530 
00001540 
p OOP I 5 50 _ 

00001550 

00001560. 

00001570 

00001570 

000J15B0 



^- -.70. 



C 



7 • 



TITLE VII PROGRAH 
PRUtBA - FALL 1985 LAB-FALL85 
TUTOT DATA SEL 



5A-i6Y002 0301 13:09 FRIOAY» DECEMBER I2f 1986 

LA8«SPRINC 86 BYOOl 0102 
BYOOl 0105 



23 



STUDENTS MERE NOT TUTORED 



GRADE 07 



PREENG 



ITUIGRDUP 



lOZERO HOURS 



> 

m 
a 

X 

> 



I TOTAL 



I 

■■■ 

1 MEAN I 

I 1 
I 1 

181 39.281 
181 39.281 



PDSTENG 



LABGAIN 



i MEAN I N I Hty.i 

1 I I 

181 45.941 131 6.671 

181 45.941 181 6.671 



72 




7S 




:> 

u) CIJ 
I— I 

X 

" 3>" 



00 



ro 



STUOtNTS WERE NOT TUTORED 



GRADE 08 



Tb'TGROUP 
OZERG HOURS 



TOTAL 



I 
I 

-I 
I 

I 



PREENG 



N 



I 

1 I 
I I 

39| 48.621 



341 48.62i 



P OSTENG J LABGAIK | 

JL. I JEAN I "^N TmEAn"'! 

"] " j I 1 

I i 1 I 

^391 56.921 39J B.3l| 

3VI 56.921 39 J 87311 



74 



/.J 




00. 



ro 



TITLE VII PROGRAM 
PRUEBA - FALL 1985 LA8«-FALL85 
rUTOr DATA. SET 



5A-8Y002 0301 13:09 FRIOAYt DECEMBER 12f 1986 

LAB-SP><ING 86 BYOOl 0102 

3Y001 0105 — 



25 



STUDENTS WERE NOT TUTORED 



GRADE 09 



ITUIGROUP 



lOZERO HOURS 



PREENG 



POSTENG 



.1 



_LA8GAIN 



I TOTAL 



CO 



o 

X 

> 



1 MEAN 1 N 
I I 

1111 
21 45.00t 21 61.001 



1 MEAN 



21 45.001 




.21 _.U6.00| 



21 61.001 



2i 16.001 



-7-6--- 




7/ 



if 



TITLE VII PROGRAM 
PAUEBA - FALL 19B5 LAB-FALL8$ 
TUTOT DATA SET-^ 



$A-i6y002 0301 13:09 FRICAY, DECEMBER 12* 1986 

LAB-SPRING 06 BYOOl 0102 

... „ _ BYOOl 0105 



26 



STUDENTS MERE NOT TUTORED 



GRADE 10 



TUTGROUP 



OZERO HOURS. 



TOTAL 



PREENG 



PCSTENC 



I MEAN I 



. . 31 



52.331. 



I MEAN 

I 
I 

31 56.67 



31 52.331 



31 58.67 



LABGAIN 



I MEAN 

I 
I 

31 6.33 
31 6.33 



5 



> 

30- 

■o 

> 




St 



TITLE VII PROGRAH SA-BY002 0301 13:09 FRIDAY, OECEHBER 12$ 1986 27 

PRUEBA - FALL 1985 LAB-FALLd5 LAB«SPRING 86 BYOOl 0102 
JUTOT DATA SET _ _ ^ BYOOl 0105 



GO- 
ro 



STUDENTS WERE NOT TUTORED 



GRADE 11 



TUIGRDUP 



02ERD HOURS 



TOTAL 



m 

X 




80 



8. 




TITIE VII PROGRAM SA-BY002 0301 13:0s^ FRIOAY, 06CEHB6R 12, 1986 
PRUEBA - FALL 1985 tA8-FALL85 LAB-SPRING 86 BYOOl 0102 
. — TUTOT DATA SET . _ . , . BYOOl 0105. _ 



STUOENTS kERE NOT TUTCAEO 



GRACE 12 



ITUTGROUP 



I02ER0 HOURS 
ITOIAL 




> 



to 



> 
m 



riTLc VII PROGRAM SA-*6Y002 0301 13:09 FRIOAY* DECEMBER 

PRUEBA - FALL 1985 LAB-FALL85 LAB«SPRlNG B6 8Y001 0102 

.TUTOr .OAfA.SET BYCOl 0105 

STUDENTS WERE NOT TUTORED 



12t 1986 29 



TOTAL 



PREEiNG 



ITUTGROUP 



lOZERO HOURS 



I TOTAL 



.1 - 

■ ■■ I ■ ■■ ' 

I MEAN I 

1 I 
1 I 
651 46.77J 



POSTENG J LABGAIN 

— II I i-i ■■■ II ■■ ■ ■ ■■■I 



N I MEAN I 

1 I 

I I 

651 54.941 



I MEAN 
■» ■ 



I 
I 

651 



651 46.771 



651 54.941 



65i 



.8.171 
8.171 



NOTE: 

.529 . 

NOTE: 
NOTE: 

NOTE: 



THE PROCEDURE TABULATE USED 5.«9 SECONDS AND 590K AND PAINTED PAGES 23 TO ?.9. 

PROC DELETE DATA « BARBFlLi BARBFIL2; ._ 00001590 

THE PROCEDURE DELETE USED 2.02 SECONDS AND 2d4K. 

5AS USED 592K MEMORY. .... . 



SAS INSTITUTE INC. 
SAS CIRCLE 
PO BOX 800D 

CARYf N.C. 27311-6000 



.84 



Rir 



8,. 



86.25 
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APPENDIX A 
38 



S A S LOG VSE SAS 82.4 



VSE 3.1 JOB EV1SAS5Y 



15:05 "liESOAYf FEBRUARY 10. 1987 



note: the job EVISASBY HAS BEEN RUN UNOER RELEASE 82.4 OF SAS 
' AT'AUSTIN INDEPENDENT SCHOOL DISTRICT I01986001K 



^ JIOTE: 


CPUiq VERSION ' FF SERIAL ' 


013553 MODEL 


* 4341 . 






NOTE: 


NO OPTIONS SPECIFIED. 
















- 




00000140 


2 


OPTIONS ERRURS « 0; 








00000150 


3 


TITLE TITLE VII PROGRAM 


SA-By002 


0501; 




00000160 


' 4" 


TITLE2 PRUE6A - FALL 1985 


LAd-FALL85 


LAB-SPKING 86^ BYOOl 


0102; 


00000170 


5 


TITLE3 TUTOT DATA SET 




BYOOl 


0105; 


00000180 


6 


TITLE4 GROUP 1 » NON-TUTORED GROUP 2 


= TUTORED; 




00000190 


7 


— - • - - - 








00000200 


. 8 


DATA BARBFILl; 








00J00210 


9 


INPUT FILEID 


S 1-3 






00000220 


"""10 


STUID 


S 4-10 






00000230 


U 


STUNAHE 


S 11-30 






00000240 


12 


GRADE 


i 31-32 






00000250 


~ 13 ' 


' ~ ' SCHOOL 


i 33-35 






00000260 


14 


READ 


36-37 






00000270 


15 


LANG 


38-39 






00000<!80 


'""16 


"HATH " 


40-^1 






00000Z90 


17 


CONP 


42-43 






00000300 


18 


SOCST 


44-45 






00000310 


19 


sc 


46-47 






00000320 


20 


COHPREH 


48-50 






00000330 


21 


V0CA8 


51-53 






00000340 


"^22 


WaRKSTU" " 


54-56 ■ 






00000350 


23 


a57 PREENG 


Z02. 






00000360 


24 


259 POSTENG 


ZD2. 






00000370 


' 25~ 


- 361" PRE SPAN 


ZD2. ~ 






00000380 


26 


963 POSTSPAN 


ZD2.> 






00000390 


\ 27 


IF PREENG GT 0 AND 


POSTENG GT 0; 






00000400 


* 2B" 


"~ " LABGAIN * POSTENG" - 


PREENG; 






00000410 


29 


KEEP STUID SCHOOL 


GRADE PREENG 


POSTENG LABGAIN; 




00000420 


30 


CARDS; 








00000430 



note: invalid OATA FOR PCSTENG IN LINE 31 59-60. 24:31 
! NOTE: INVALID DATA FDR POSTSPAN IN LINE 31 63-64. 26^31 
"NOTE: FURTHER ERRORS OF THIS TYPC WILL NOT BE PRINTED. 
OPTIONS ERRORS^'NN; ♦ LIMIT REACHED. 



'" rule: 1234567 101234567 201234567 301234567 401234567 t>01234567 601234567 701234567 80 
, 31 AVW1330301CASTR0tRAFAEL 12003 83 90 00000010 

^ FILEID'AVW STUI0»1330301 STUNAME*CAS TKO. RAFAEL GRA0E=12 SCH00L*003 READ*. LANG=. MATH*. COMP=. SOCST*. SC=. COMPREH*^. 
VOCAB*. hORKSTU«. PREENG*83 POSTENG*. PREf>ft.\'«90 POSTSPAN=. LABGAIN^. .,ERR0R_*1 .N_« 1 
NOTE: OATA SET USEROID. BARBF ILl HAS 159 OBSERVATIONS AND 6 VARIABLES* 198 OBS/TRK. 
note: THE OATA SIATEMENT USED V.28 SECONLS UUQ 344K. 



249 ; 00000450 

250 - - " 00000460 Q CJ 

251 PROC sort: 00000470 

252 BY STUIO^ 00000480 
~ 253 00000490 



Morning: sortsize value is less than the minimum 



S A S LOG VSE SAS 82,4 



VSE 3.1 JOB EVlSASay 



-♦—I 
X 



NOTc 
NOTE 

254 

255 

'256 

257 

258 
'259 

260 

261 
r 262 

263 

264 
"^65 

266 

267 
"268 

269 

270 
-271 - 

272 
273 
~274 

note: 
•note: 
NOTE: 
NO)E: 
T^OTE: 
NOTE: 



rule: 



- ^^^^ SYSTEM SORT UTILITY. 

THE SORT UTILITY MAY TERMINATE ABNORMALLY 



15:03 TUESDAY, FEBRUARY 10, 19B7 



CATA BARBFIL2S 



INPUT 



9^0 

iH5 

^ asQ 

d55 
d60 
TUTTOTAC 
TUTTOTAL 
TUTTOTAL 
TUTTOTAL 
TUTTOTAL 

TUTTOTAL 

"GROUP 
IF TUTTOTAL GT 0 
KEEP STUIO TUTTOTAI 
CARDS; 



SCHOOL 
GRADE 
STUID 
STUNAMf? 
"SEMESTER 
TUTREAD 
TUTLANG 
TUTMmTH 
TUT sec ST 
TUTSCI 
'« o; - ■ 
TUTREAn; 

tutlang; 

TUT MATH; 
TUTSOCSTJ 
TUTSCI; 



i-3 

5-6 

8-14 

16-35 

38 

Z04.2 
Z04.2 
ZD4.2 
Z04. 2 
Z04.2; 



rhEN GROUP = 
GROUP; 



INVALIC DATA FOR TUTREAD IN LINE 275 40-43 
INVALID DATA FOR TUTLANG IN L NE 275 45.4b'- 
INVALID DAIA FOR TUTMATH IN t Si "5 SO-SS! 
INVALID DATA FOR TUTSOCST IN LINE 275 55-58 

FURTHER ERRORS Of THIS TrPE WILL NOT BE PRINTFn 
OPTIJNS ERRORS^NN; ♦ LIMIT REACHED. 



00000 500 

00000510 

00000520 

00000530 

00000540 

00000550 ' 

00000560 

00000570 

00000580 

00000590 

00000600 

00000610 

00000620 

00000o30 

00000640 

00000650 

00000660 

00000670 

00000680 

00000690 

00000700 



260:31 
261:31 
262^31 
263:31 
264:31 



123.567 10123.567 20123.567 30123.567 .0123.567 50123.567 60U3.567 70123.567 



275 003 09 19573^1 DELEON MARTA 



80 



TUTREAD^ 



443 
444 
445 
446 
447 
44B 



PROC SORT; 
BY STUID; 



warning: sortsize value is less than the minimum 

RECUIREO SY your SYSTEM SORT UTILITY. 

THE SORT UTILITY MAY TEP.MINATE ABNORMALLY 

OATA BARBFILl; 
.^50 INFILI « 0; 



00000010 
TUTLANG=. TUTMATH= 



00000720 
00000730 
00000740 
0 COO 0750 
00000760 
00000770 



00000780 
00000790 



00 



ro 



TUTSOCST^. TUTSCI^i 



3 S A S LOG VSE SAS 82«4 VSE 3.1 J08 EVlSASSy 15:03 TUESDAY. FEBRUARY 10« 1987 

•:!, 

451 NERGE BARBFILl C IN « INFILl) 00000800 

r^45Z 'BARBFIL;?; 00000810 

> - 453 8Y STUlO; 00000820 

. 454 IF INFILl _ 00000830 05 

'~"<55 IF GROUP « r THEN GROUP » 00000831 ' o>" 

• 456 IF TUTTOTAL « • THEN TUTTOTAt * O; 00000832 1:^3 
457 _ 00000840 oi 

> I NOTE: CHARACTER VALUES HAVE BEEN CONVcRTEO TO NUMERIC 
^1 VALUES ^T_THE PLACES^ GIVEN BY: ( LINE) 5 C COLUMN I . 

455;8 

• ri4OTE:~BATA~'SEriiSER0l0.BARBFILl HAS 159 OBSERVATIONS AND 8 VARIABLES. 162 OBS/TRK. 
*> I NOTE: THE uATA STATEMENT USED 4.76 SECONOS ANO 334K. 

^^45^8 PROC^SORT;' ' 00000841 

O 459 BY GROUP; 00000842 

• 460 00000850 



WARNING: SORTSUE VALUE IS LESS THAN THE MINIMUM 
REQUIRED BY YOUR SYSTEM SORT UTILITY. 
THt~SORT UTILITY >*rY TERMINATE ABNORMALLY. 
O note: data set USEROIO.BAABFILI has 159 OBSERVATIONS AND 8 V..RUBLES. 162 OBS/TRK. 
> - NOTEJ^THE PROCEDURE SORT USED 20.11 SECONDS ANO 342K. 

r3,50.: 461 PROC FREO; 00000860 
h^O - I 462 TABLES SCHOOL GRADE GROUP TUTTOTAL; 00000870 
^ . '"46J 0000088C 



O • 

> NOTE: SEE~>«-~*FOR TABLE LOCATION IN PRINT FILE 



■L. 



I 



91 
ERIC. 



483 
484 
485 
486 
1 487 
488 

• 489 
490 
491 

~492 
493 
494 

' 495 
496 



V2<PRErEST; 

V8>o; 
V9»o; 

IF GROUP EQ I TK:-N V8>I; 
IF GROUP EG 2 THEN V9«I; 
V3*V2*V8; 

V4»V2*V9; 

V5»V2**2; 
V6*V5*V8; 
V7*V5*V9; 

FULLOMING ARE REGRESSION STATEMENTS FOR TWO-GROUP SORESPOT 



0 0001080 
00001090 
00001100 
00001110 
00001120 
00001130 
00001140 
00001150 
00001160 
00001170 
00001180 
00001190 
00001200 
00001210 



cx> 



ro 



~note; character values have been converted to numeric 
values at thie places given by: (line)z(column). 



486:7 ^87; 7 



NOTE: DATA SET USEROlO .BARBF ILl HAS 159 OBSERVATIONS AND 19 VARIA<>.ES. 58 OBS/TRK. 
'"NOTE: THE DATA STATEMENT USED 4.66 SECONDS AND 334K. ' 



4^ m 
o 

X 



496 
497 
498 



PROC glm; 

•"MODEL V1*V3 V4 V6 V7 V8; ^ 



[ ^ V- ^ ^ 

.... .. I ;• A A 



00001210 
00001220 
00001230 



93— 




95 




TITLE VII PR06RAH 
PRUr:8A « FALL 1985 LAB«FALLd5 
TUTOT DATA SET 

GROUP I » NON-TUTORED 



SA-BY002 0501 
LAB-SPRING 86 



GROUP 2 

ENGLISH LAS IN FALL 1985 AND SPRING 1986 



15:03 TUESDAY. FEBRUARY 10, 1987 
BYOOl 0102 
BYOOl 0105 
TUTORED 



GENERAL LINEAR MODELS PROCEDURE 



DEPENDENT VARIABLE: VI 



^SOURCE 


D«= 


SUM OF SQJARES 


MEAN SQUARE 


F VALUE PR > F / R 


-SQUARE \ 


C.V. 


MODEL 


5 


22209. 12416856 


4441.82483371 


49.83 0.0001 Vo. 619532 / 


18.2986 


ERROR 


153 


13639.114825?5 


89.14454134 


ROOT MSE 




VI MEAN 


■""CORRECTED TOT AC 


" " 158 ■ 


35848.23899371 




9.44163870 


51.59748428 


rsouRcr 


" DF 


TYPE I SS 


F VALUE PR > F 


DF TYPE in SS 


f VALUE 


PR > F 


. V3 

V6 
V7 

~"va ~ " 

( 


_ 1 

1 
1 
1 


8654.40598560 
12973.14340197 
4.33771056 
178.76041614 
398.47665428 


97.08 O.OQOl 
145.53 0.0001 
0.05 0.8257 
2.01 0.1588 
4.47 0.0361 


1 2.48429678 
1 408.92322272 
1 415.11239557 
1 45.95642402 
1 39S.47665428 

STD ERROR OF 
ESTIMATE 


0.03 
4, 59 
4.66 
0.52 
4.47 


0.8676 
0.0338 
0 .0325 
0. 739 
0.0361 


PARAMETER 


ESTIMATE 


T FOR HOT ■ 

PARAMETER -0 


— PR > IT! 






•"INTERCEPT" * 
V3 
V4 

^ V6- - - 

V7 
V8 


7,49369350 
-0.06347165 

1.26983621 
" 0.00917188 
-0.00525153 
28.85077698 


0.67 
-0.17 
2.14 
2.16 
-0.72 
2.11 


0.5019 
0.8676 
0.0b38 
0.0325 
^^.4739 
0.0361 


11.13197682 
0.38021165 
0.59289010 
0.00425033 
0.00731409 

13.64593976 







note: the PROCEDURE GLM USED 7.62 SECONDS AND 718K AND PRINTED PAGE 6. 



498 
'499 
500 



PROC GLM; 

" HODEL V1«V3 V4 V5 V8; 



00001230 
DODO 1240 
00001250 



J- 



o 
o 



96 



ERIC, 



TITLP VII PROGRAM SA-BY002 0501 15:03 TUESDAY. FEBRUARY lO. 1987 7 

TUTOT OATA^SET ^ ^ ^q^.^uTOREO CROUP 2 * TUTORED 

ENGLISH LAB IN FALL 1985 AND SPRING 1986 ♦♦♦♦♦ 

GENERAt LINEAR MODELS PROCEDURE 



DEPENDENT VARIABLE: VI 
SOURCE 

MODEL _ 

ERROR 

CORRECTED'TOTAL 



SOURCE 
V3 

V4 ■ 

V5 
V8 



PARAMETER 

INTERCEPT 
V3 
V^ 
V5 
V8 



- DF 

15^ 
158 

DF 

I 
I 
I 
1 



SUM OF SQUARES 
219^9. 97311U8 
13898.26588223 
358^8.23899371 



MEAN SQUARE 
5487*49327787 
90.24847975 



TYPE I SS F VALUE PR > F 



8654.40598560 
12973.14340197 
134.50573896 
187.91798495 



95.90 
143.75 
1.49 
2.08 



0.0001 
0.0001 
0.2240 
0.1511 



- ESTIMATE 

22.9495 2831 
0.25769249 
0.40688983 
0.00553075 
7.15385162 



T FOR ho: 
PARAMETER»0 

3.53 
0.78 
1.31 
\.50 
1.44 



PR > ITl 



0.0005 
0.4393 
0.1923 
0.1368 
0.1511 



SStEz'tHE procedure GLM USED 9.38 SECONDS AND 718K ANO PRINTED PAGE 7. 



500 
501 
502 



PROC glm; 

MODEL V1^V2 V5 V8; 



F VALUE 
60.80 



OF 

1 
I 
1 
1 



PR > F 
0.0001 
ROOT MSE 
9.49991999 



R-SQUARE 
^0.612303 



54.26921613 
"154.76868227 
201. 1776251 
187.91798495 



STD ERROR OF 
ESTIMATE 

6.50118205 
0.33231116 
0.31071001 
0.00369757 
4.95764816 



00001250 
00001260 
00001270 



- C.V. 
18.4116 
VI MEAN 
51.59748428 



TYPE in SS F VALUE 



PR > F 



0.60 0.4393 

1.71 0.1923 

2.24 0.1368 

2.08 0.1511 



97 




OEPENOENT VARIABLE: VI 

'SOURCE ' ' ■ OF 

JIOOEL^ _ _ ^ 

ERROR 155 

CORRECTED TOTAL" ^ 158 



TITLE VII PROGR/IH 
PRUE6A - FALL 1985 LA8*rALL85 
TUTOT OATA SET 

GROUP r » NON-TUTOREO" " 



SA«BY002 0501 
LA6«SPR1N6 86 



GROUP 2 



15:03 TUESOAYt FEBRUARY lOt 1987 
BYOOl 0102 
BYOOl 0105 
TUTORCO 



««««« ENGLISH LAB IN FALL 1985 ANO SPRING 1986 ♦♦♦♦♦ 



GENERAL LINEAR HOOELS PROCEOURE 



SUM OF SQUARES 
21805.862503B7 
14042.37648984 
35848.23899371 



HEAN SQUARE 
7268.62083462 
90.59597735 



F VALUE 
80.23 



PR > F 
0.0001 
ROOT MSE 
9.51819192 



> 



R-SOUARE ' C.V« 
0.608283 18.4470 
VI HEAN 
5U59748428 



00 



-•"SOURCE 

V5 
V8 



> ^- 
m 

X 



> r 



PARAHETER 

INTERCEPT 
V2 

V5 ^ 

'V8 



OF 

1 
1 
1 



TYPE I SS 

21600.77899504 
152.^6126617 
52.62224266 



ESTIMATE 

24.84958041 
0.40662170 
0.00433513 
1.22768276 



T FOR ho: 

PA^AMETER*0 

3.92 
1.31 
1.21 
0.76 



F VALUE 

238.43 
1.68 
0.58 



PR > F 

0.0001 
0.1965 
0.4471 



PR > ITI 



0.0001 
0.1934 
0.2279 
0.4471 



L. 



NOTE: THE PROCEOURE GLH USEO 11.84 SECONOS ANO 718K ANO PRINTEO PAGE 8. 



502 
503 
' 504* 



PHOC GLH; 
MODEL V1=V2 V5; 



OF 

1 
1 
1 



STO ERROR OF 
ESTIMATE 

6.33707636 
0.31130755 
0.00358134 
1.61085311 



TYPE III SS 

154.56484062 
132.7458026Y 
52.62224266 



00001270 
00001280 
00001290 



F VALUE 

1.71 
1.47 
0.58 



PR > F 

0.1934 
0.2279 
0.4471 



ERIC 



9ii 



Id 




OEPLNOENT VARIABLE: VI 

"^SOURCE " OF 

MOO EL ^ 2 

ERROR 

XORRECTCO TCUL * " 158 



PRUF3A . FAii ^'oRr 7*^2*.... 5*"fI2?f.^'^^ "-^^ TUESDAY. FCBRUARy 10. 1987 9 

^^i;!! «T*^^eb*^^®^ LA8-FALL85 LA8-SPRING 86 BYGG) 0l02 

TUTOT DATA SET gyoQi ol05 

GROUP I » NON-TUTOREO CROUP 2 « TUTORED 

♦♦♦♦♦ ENGLISH LAO IN FALL 1985 AND SPRING 1986 ♦♦♦♦♦ 
GENERAL LINEAR MODELS PROCEDURE 



SUM OF SQUARES 
21753.2^026121 
K0<;^*998732 50 
356^8«23899371 



MEAN SQUARE 
10676.62013061 
90*35255598 



F VALUE 
120.38 



PR > F 
O.OOOl 
ROOT MSE 
9.50539615 




00 



ro 



SOURCE 
V2 

V5 



OF TYPE I SS 

1 21600.7789950^ 
""l 152.46126617 



r VALUE 

239,07 
1.69 



PR > F 

0.0001 
0.1959 



OF 

1 
1 



TYPE III SS 

56290892 
152.46126617 



F VALUE 

1.60 
^ 1.69 



PR > F 

0.2078 
0.X959 



m 

si 

X 



PARAMETER 

INTERCEPT 

V2 

V5 



ESTIMATE 

"25.61971637 
0.39255346 
0,00462046 



FOR HO: 
PARAMETER^O 

" 4.10 
1.26 
1.30 



PR > JTI 



0.0001 
0.2078 
0.1959 



note: the procedure GLM used 7.86 SECONDS AND 718K AND PRINTED PAGE 9. 
504 PROC glm; 



STO ERROR OF 
ESTIMATE 

6.24758069 
0.31034203 
0.00355693 



00001290 



V 



ioi 



ERIC 



505 
506"" 



S A S LOG VSE SAS 62.4 
MODEL V1«V3 VS; 



VSE 3.1 JOB EVISASBY 



15:03 TUESDAY, FEBRUARY 10» 1987 



00001300 
00001310 



00 



ro 
cn 



> 

m 

X 




f>3 



ERIC 



TITLE VII PROGRAM SA-BY002 0501 15:03 TUESDAY, FEBRUARY lOt 1987 10 

PHUEBA • FALL 1985 LA8-FALL85 LA8-SPRING 86 8Y001 Ol02 

TUTOT DATA SET 8Y001 0105 

GROUP I * NON<-TUTOREO GROUP 2 « TUTORED 

ENGLISH LAB IN FALL 1985 AND SPRING 1986 ***** 



GENERAL LINEAR MODELS PROCEDURE 



DEPENDENT VARIABLE: VI 

SOURCE ■ OF 

HUOEL „ ^ 

ERROR 155 

"CORRECTED "TOTAL " 158 



SUH OF SQUARES 
2i748,0553A897 
UIOO.1836^^7^ 
358^8.23899371 



HEAN SQUARE 
7249.35178299 
90.96892674 



F VALUE 
79.69 



PR > F 
O.OOOl 
ROOT KSE 
9.53776319 



R-SQUARE 
0.606670 



) ~ c-v. 

18.4849 
VI HEAN 
51.59748428 



SOURCE 
V3 

■V4 

V8 



OF TYPE I SS 

I 8654.40598560 

I 12973. 14340197 

I 120.50596140 



F VALUE 

95.14 
142.61 
1.32 



PR > F 

0.0001 
0.0001 
0.2515 



DF TYPE III SS 

I 12350. 3II25I93 

1 7264.67454131 

I 120.50596140 



F VALUE 

135.76 
"79.86 
1.32 



PR > F 

0.0001 
0.0001 
0.2515 



PARAMETER 

INTERCEPT 
V3 

V4 ■ ~ ■ 

ve 



ESTIMATE 

15.C2148746 
0.7455299P 
0.84953652 
5.60188648 



T FOR ho: 
PARAMETER=0 

3.97 
11.65 
8.94 
1.15 



PR > |T| 



0.0001 
0.0001 
0.0001 
0.2515 



NOTE; THE PROCEDURE GLM USED 9.65 SECONDS AND 718K AND PRINTED PAGE 10. 



506 
507 
"508 



PROC GLM; 
MODEL V1=V2 V8; 



STO ERROR OF 
ESTIMATE 

3.77962558 
0.06398419 
0.09506497 
4.86717065 



00001310 
00001320 
00001330 



o 
o 
o 
o 



DEPENDENT VARIABLE: VI 

SOURCE'"' " 
_MOpEL 

ERROR 
-CORRECTED TOTAt 



rSOURCE' 

I 

! V2 



TITLE vn PROGRAM 
PRUE8A « FALL 1985 LAB-FALL85 
TUTOT DATA SET 

GROUP I » NON-TUTOREO 



SA-By002 0501 15:03 TUESDAY, FEBRUARY 10» 1987 
LAB-SPRING 86 BYDOl 0102 
BYOOI 0105 
GROUP 2 » TUTORFD 



II 



♦♦♦♦♦ ENGLISH LAB IN FALL 1985 A^D SPRING I9L6 



GENERAL LINEAR HOOr^S PROCEDURE 



DF 
2 

156 

158" 

or 
r 



SUM OF SQUAhES 
21 673. 1 1670120 
HI75. 12229252 
35848.23899371 

TYPE I SS 

21600.77899504 
72.33770615 



MEAN SQUARE 
10836.55835060 
90.86616854 



F VALUE 

237.72 
0.80 



PR > F 

0.0001 
0.3736 



' VALUE 
119*26 



OF 

I 
I 



-6 



PR > F ' R-SQUARE j C*V. 

0.0001 y 0.604580 ^ 18.4745 

ROOT MSE ^ VI MEAN 

9.53237476 51.59748428 



TYPE III SS 

19540.04714546 
72.33770615 



F VALUE 

215.04 
0*80 



PR > F 

0.0001 
0.3736 



00 



X m 



L 



PARAMETER 

INTERCEPT' 
V2 
V8 



ESTIMATE 

17;71729153" 
0.77795628 
I.43I52I12 



T FO'^ ho: 

PARAr .TER»0 

7.58" 

14.66 
0.89 



PR > |T| 



0.0001 
0.0001 
0.3736 



NOTET THE PROCEDURE GLM USED 7.23 SECONDS AND 7I8K AND PRINTED PAGE II. 



508 

509" 

51C 



PROC GLM; 
"MODEL VUV2; 



STD ERROR OF 
ESTIMATE 

2.33612126 
0*0530 5099 
I. 60441422 



00001330 
000013^0 
00001350 




DEPENDENT VARIABLE: VI 
'SOURCE OF 

MODEL _ I 

ERROR 157 
CORRECTEO TOTAL 158 



TITLE VII PROGRAM SA-8Y002 0501 15:03 TUESDAY, FEBRUARY 10, 19B7 12 

PRUEBA - FALL 19B5 LAB-FALLB5 LAB-SPRING B6 BYOOl 0102 

TUTOT DATA SET BYOOl 0105 _ 

GROUP I » NON-TUTORED GROUP 2 » TUTORED 

♦♦♦♦♦ ENGLISH LAB IN FALL 19B5 AND SPRING 19B6 ♦♦♦♦♦ 
GENERAL LINEAR MODELS PROCEDURE 



SUM OF SQUARES 
21600. 77B99504 
l^2^T.45999B67 
35B4B.23B9937I 



MCAN SQUARE 
21600.77899504 
90.74815286 



F VALUE 
23B.03 



" PR > F 
0.000 1 
ROOT MSE 
9.52618249 




CD 



•no 



X 



SOURCE 
V2 



DF 
1 



TYPE I SS 
21600.77899504 



PARAMETER " 
INTERCEPT 



ESTIMATE 

18.07179118 
0.79018458 



T FOR ho: 
PARAMETER^O 

7.86 
15.43 



F VALUE 
238.03 



PR > F 
0.0001 



PR > |T| 



0.0001 
0.0001 



note: the PRCCj'^URE CLM USED 6.80 SECONDS AND 718K AND PRINTED PAGE 12. 

"511 PROG DELETE DATA » BARBFILl 8ARBFIL2; 

note: the PROCfcDURE DELETE USED 2«66 SECONDS AND 334K. 
-NOTE: SAS USED 718K MEMORY. 

note: SAS INSTITUTE INC. 
SAS CIRCLE 
PO BOX 8000 

CARY, N.C. 27511-8000 



OF TYPE III SS 

1 21600.77899504 



SID ERROR OF 
ESTIMATE 

2.30059135 
0.05121684 



F VALUE 
238.03 



PR > F 
0.0001 



00001360 



1±J 
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S A S LOG VSE SAS 82.4 



VSE 3.1 JOB EVISAS 



9:07 WEONESOAYt FEB.lUARY lU 1987 



> 

m 




note: The JOB EVliAS HAS BEEN KUN UNDER RELEASE 32.4 OF SAS 
AT AUSTIN INJEPENOENT SCHOOL DISTRICT (01986001). 



NOTE: CPOID VERSION 



Ff SERIAL = 013553 MUDEL = <»34l . 



note: i^O JPlIONi SPECIFIED. 

■♦♦»<i«/hIS is for 2-GRGUP SORESPOT. see SA-PSOlO 0301 FOR 3-GROUP****; 



1 
2 
3 

5 

6 

7 

8 

9 

10 

11 

12 

13 



TiTLcl AUSTIN IiWDEPENDENT SCHOOL DISTRICT 
1 ITLi:2 OFFICE OF RESEARCH AND EVALUATIJN 
TlTLc3 • 

TITLt4 F CALCULATED FROM R SQUARES 
TITLE5 • 



DATA spot; 
ISPUI GRAOE 1-2 

CARDS; 



TEST S 3 <ftS^l-KSQ7) (6.6) .N 46-49; 



00000070 
00000080 
00000090 
RCTENTION; 00000100 
SA-JF065 0601 X; 00000110 
00000120 
X; 0000013D 
00000140 
00000150 
00000160 
00000170 
00000180 
00000190 



note: data set USEROIO.SPOT HAS 1 OBSERVATIONS AND 10 VARIABLES. 102 GBS/TRK. 
NOTfc: ThL DATA STATcMENT USED 2*30 SECONDS AND 322K. 



15 
16 
17 
18 
19 
20 
2) 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 

NOTE: 



DATA :>POT; 

SET spot; 



ir 
IF 
IF 



TEST EQ 
TEST EQ 
TEST EQ 



• !• THEN TEST-'HEADING' ; 
•2» THEN lEST-'LANGUAGE' ; 
•3« THEN TEST^'MATH'; 



F15=( (RSwl« 
F12-((RSQ1- 
F23=((RSG2' 
rl3=l(RSwl' 
F34=< (RS';3' 
F56=((RSQ5 
Fu7=( (RSUo 



•RS45)/2)/l( I- 
'RS02)/1 )/((!• 
-HS03)/1)/1< 1- 
•RS43)/2)/(l 1- 
•RSQ4)/1 )/n 1- 
-RSQ6)/1)/((1« 
•RSvi7)/l)/U 1- 



>RS^i)/(N-6n ; 

-RSQl )/(N-6) ) ; 
'RS02)/(N-5) ) ; 
•RSC l)/<N-6) } ; 
'RS03)/<N-4) ); 
•HSC5)/(N-4) \ ; 
'RSvi6)/(N-3)) ; 



DATA ScT UScKOIO.SPOT HAS 1 OBSERVATIONS AND 17 VARIABLES. 60 03S/TRK, 
THt JATA STATEMENT USED 3*49 SECUNOS AND 30oK. 

PRCC SuRT; 

dV oi^AOE TEST; 



32 
33 
34 
J5 
36 

WA.^NIlw: :>uKTilZE VALUE IS LESS THAN Tilt .M1NI;<UM 

.\CQj1FcU by your SYSTEM SORT JTILITY. 

THE SjkT UTILITY MAY TERMINATE ABNORMALLY. 
NOTE: JATA :>£T USEROIO.SPOT HAS 1 OBSERVATIONS ANj U VARIA3LES. 60 03S/TRK. 
NOTE: IHt PROCCJJRE SORT USED 21.74 SECONDS AND 292K. 



00000220 
00000230 
00000240 
00000250 
00000260 
00000270 
00000230 
00000290 
00000300 
00000310 
00000320 
00000330 
00000340 
00000350 
00000360 
00000370 
00000380 
00000390 



00000390 
00000400 
00000410 
00000420 
00000430 



an 



0) rt- 
(D O 
3 

n> 

O 3 
to 7> 

CO 



L J 



VS^ SAS 82.^ 



VSe 3.1 JOB ERISAS 



36 
37 
38 
3^ 
40 
41 
42 
43 
44 
45 
46 
47 
48 
49 



Pagc print; 

av OkAOE TEST; 



(I VS. 

(I vs. 

(2 VS. 

(I VS. 

13 VS. 

<5 VS. 

<6 VS. 



5) 
2) 
3) 
3) 
4) 
6) 
7) 



ARE 2,N-6 

1 fN-6 
ltN-5 

2 »N-6 

ltN-3 



9:07 WEDNESDAY, FEBRUARY II, 1987 



00000430 
00000440 
00000450 
00000460 
00000470 
00000480 
00000490 
00000500 
00000510 
00000520 
00000530 
00000540 
00000550 
00000560 



CO 



f\5 



3> 
"a 
-o 
m 

^— < 

X 
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^ > 

D) rf 
CO 

O) n 

fN3 3 
(D 

O 3 
rf 

CO > 



ERLC 



> 

m 

X 



COS 
I 

J3S 



AJSTIN INJEPeNDENT SCHOUL DISTRICT 
OFFICE OF RESEARCH AND EVALUATION 

F CALCULATED FRuH R SOUARcS 



GRADE=0 TEST = R 

kSyi RSG2 RSQ3 RSQ4 

0.619532 0*612303 0.608283 0.606815 
N F15 F12 F23 F13 



Pe TENT ION I 
SA-JF065 0601 X 

9:0r WEDNESDAYf FEBRUARY lit 1987 
X 



00 



ro 



RS05 
0.60667 

F34 



RSQ6 
0.60458 

F56 



RSQ7 
0.602562 

F67 



I 159 2. 586U 2.90704 1.59681 2.26182 0.500379 0.823609 0.796136 

NUTE: the P.^GCEJJRE PKira used 2.53 SECaNJS AKD 356K AiJD PKINTGD PAGE U 



49 

50 . 

NOTE: 
NOTE: 



PRUC DELETE DATA^SPOT; 



THu FKOCEOUJ^E OfcLETE USED 1.2i SECONOS AMD 284K. 
SAo USED 3I36K ME-MURY. 



00000560 
00000570 



NuTt: SAS INSTITUTE IiNC. 
3AS CIRCLE 
Pu tiuX aooo 

CARff ;m.C. 27511-80C0 
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IOWA TESTS OF BASIC SKILLS (ITBS)/ 
TESTS OF ACHIEVEMENT AND PROFICIENCY (TAP) 

Purpose 

The Iowa Tests of Basic Skills (ITBS) and the Tests of Achievement and 
Proficiency (TAP), Reading, Mathematics, and Language totals provided 
information concerning: 

Decision Question Dl : Should the Title VII program be continued as it 
IS, modified, or discontinued? 

Evaluation Question Dl-2 . What achievement gains were made by 
project participants in: 

a) Reading? 

b) Mathematics? 

c) Language? 

Evaluation Question D1--5 . How do the English proficiency and 
achievement gains of students receiving tutoring compare to 
students who were not tutored? (Johnston experimental versus 
control group; Murchison experimental versus control group). 

Information Need 12 . Did the project meet its objectives? 

Procedure 

The ITBS is administered to all AISD students, grades K-8, while its continua- 
tion, the TAP, is given to students, grades 9-12. Both are administered as 
part of the regular districtwide testing program in Apri and May of each year 
All project LEP A&B students are required to attempt the ITBS/TAP. However, 
if it is obvious they cannot handle the level of English proficiency required 
on the first test, the students are permitted to discontinue. This is based 
on teacher judgement that the student would be unable to answer one out of 
four items correctly. A separate decision is made for each subsequent subtest 
as a student who may not be able to take a reading comprehension test may be 
able to do reasonably well on a mathematics computation test. Subtests with 
an insufficient number of responses are automatically discounted when machine 
scored. A project student may also not be tested if that student was absent 
during the regular and make-up sessions of the the districtwide testing. 

All tests were administered by classroom teachers. All scoring was handled by 
the Office of Research and Evaluation (ORE). 

The programmer analyst created the Title VII SAS Data Set (BARB 8586) from 
district records which had the students' recorded ITBS/TAP scores for 1985 and 
1986. 
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Results 

Evaluation Question Dl-2 . What achievement gains were made by project 
participants In: 

a) Reading? 

b) Mathematics? 

c) Language? 

The percentile gains of LEP A&B students with an ITBS pre- (1985) and posttest 
(1986) were examined. The percentage showing gains in test areas was: 

Reading 55% (N=64) Social Studies 57% (N=68) 

Language 72% (N=65) Science 25% {N=12) 

Mathematics 62% (N=61) 

Science scores from Murchison were not included, because junior high school 
students in AISD do not take the ITBS Science subtest. 

Evaluation Question Dl-5 . How do the English proficiency and achieve- 
ment gains of students receiving tutoring compare to students who were not 
tutored? (Johnston experimental versus control group; Murchison experimental 
versus control group). 

The programmer analyst merged the ITBS and TAP scores for 1985 and 1986 on the 
Title VII SAS Data Set (BARB8586) with the 1985-86 tutor Data Set 
(SA-BYOOl-0105). He ran a PROC MEANS (SA-BY002-0401) which looked at the 
grade equivalents (GE's) of tutored and nontutored students by subjects. 
Tutored students' mean gains were first examined by time tutored. The three 
time interval groups were: 

0 Greater than one hour but less than two hours; 

0 Greater than or equal to two hours but less than eight hours; and 

0 Greater than or equal to eight hours. 

No consistent patterns emerged (sample sizes were quite small). 

ITBS/TAP 

The number of project LEP students who had test scares for both spring, 1985 
and spring, 1986 was limited because: 

— Many students enrolled in AISD in fall, 1985, and therefore had no 
scores for spring, 1985. 

— LEP A and B students are often exempted from taking the ITBS/TAP test 
because of limited knowledge of English. 

As can be seen in Figure B-1, the number of tutored LEP students with test 
scores was less than 10 except in language. Significance tests were therefore 
not done. In language, tutored students made mean gains of .96 RE in a year, 
while nontutored students made average gains of 1.60 GE years. 
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SUBJECT 


N 


1985 
MEAN 


MEAN 


MEAN 
GAIN 


TUl 


rORED 


Reading 


2 


3.95 


5.45 


1.50 


Language 


21 


4.80 


5.76 


.96 


Mathematics 


7 


5.29 


7.04 


1.76* 


Soc. Studies 


4 


5.58 


8.05 


2.48* 


Science 


2 


7.40 


8.15 


.75 


NONTUTORED 


Reading 


56 


4.96 


5.93 


.97 


Language 


36 


4.79 


6.39 


1.60 


Mathematics 


51 


6.29 


7.28 


.99 


Soc. Studies 


53 


5.07 


6.19 


1.12 


Science 


05 


6.90 


7.10 


.20 



Figure B-1. ITBS/TAP GRADE EQUIVALENT (GE) GAINS 
FOR TUTORED AND NONTUTORED HISPANIC 
LEP A & B STUDENTS AT PROJECT SCHOOLS. 
Grades 7-12 combined except for science 
test (grade 9-12 only). Social studies 
is measured by Work Study Skills (ITBS) 
and Social Studies (TAP). 
* = Difference between reans gains and 
reported total gain is due to r*>unding off. 




Several factors should be considered in interpreting these results. 

0 Many students scored at the chance level on both the pre- and 
posttests. Also, there was great variability in the size of 
gains made by individual students. 

0 The best comparison group available was tutored vs. nontutored 
students. However, students were not randomly assigned to be 
tutored or not. It appears the lowest achievers were tutored. 
Therefore, groups are not as comparable as would be desired. 

Changes in the tutor component which might enhance effectiveness are 
discussed in the Tutor Appendix G. 
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UT-jT JATA Scf 



15:04 TJESOAY, JA.NUAKY 27, I9tt7 
X 



liYCOi 0105 



VAKlAbLc 



MATHGI:3 
NATHGE6 



5.2357 
7.0429 
1.7571 



^TANDARJ 
JEi/lATluN 

0.5956 

' 1.07O8 



4. iOuO 
5.dC00 

Cr • OwlOu 



..AXIHUiM 
VALUE 

6. 1000 
d.5000 
3.^000 



3T0 kRi<OK 
OF iEAH 

0.2251 
U.42e7 
0.4070 



C. V. 



11.268 
16.103 
^61.282 



PK>i n 



23.48 O.OOOl 
U.43 0.0001 
"4.i2 0.0050 



00" 
cn 



ro 

LXL. 



VAHlAbLE 



MArHGE5 
MArHGc6 
-HAHiuAnr 



51 
51 

-5r 



6.2941 
7.284* 



STA.^OAKO 
_CEVlAnON 

1.4746 
1.2970 

n3^)73 



iMAT H 

STuOEriTS ^tKE NjT TUTURtO 



VALUE 

4.3C0U 
4. 7000 
5000 



MAXIMUM 
VALUE 

14. 1000 

lo.dooo 

3.2000' 



STO ERKOK 
UF MEAN 



0.20c^^ 
0.1816 

'(r.r95T 



c.v. 



23.429 
1/.805 

141.^115 



PR>|T| 



30.48 0.0001 
40.11 0.0001 
-^.06" O.OOOl 



Ol3 

o 

X — 

03 VARIABLE 



2ftJCSTi;E5 
S0CSrGt:6 
■SDCSTCAK 



MEAN 



5.5750 
8.0500 
2.4750 



STANOAKO 
CEVIATluN^ 

i.d839 
0.92 5b 
2.0304 



juLUL STUOieS 
:>TJOfc.>JTi .<ERE foruRcO 



Mi.vJiHUM 
/mLUE 

J.fOOO 
6.7o00 
J. 7000 



.4AXiMUH 

7. >000 
i. dOOO 
4. >U00 



SrO kRKOR 
OF MEAN 

0.9420 
0.<t628 
* 1.0152 



C.V. 



33.792 
11.498 

821036 



PR>|T| 



5.92 0.0096 
17. 39 0.0004 
■"2.44 0.0927 



VARIABLE 



SaCSTG£5 53 
SUCSTGfc6 53 

"""SccsrcArr 53 



MEAN 



5.0717 
6. 186B 
I". 1151 



SOCIAL STUDIES 
STUDENTS WERE NUTTUTDREO 



STANOARu 
UEViAfl JN 

1.0710 
1.2d72 
~ 1.3033 



.iiniMUM 
VALUE 

3.20U0 
4.00uu 
-1.6000 



MAXIMUM 
VALUE 

7.7O00 
10.9000 
4.6O00 ■ 



STO ERROR 
UF MEAN 

0.1471 

0.1 76a 

0.1790 



C.V. 



21.117 
20.806 
T16.879 



PR>|T1 



34.47 0.0001 
34.99 0.0001 
" t.?3 0.0001 



ft> rl i 

a> o 



CD 
3 




rirtd VI ; Hf^o^AM ^ — 

3Ai<2a5d6 - JAfA ScT • I fJS TAi> rOA ISo!) 

TUTCl uATA SET 



VAKlAULc 



ftbAOUES 
REA0CE6 



I 
I 
Z 



ME AM 



3.9500 
3.4500 
"1.5000" 



3TAN0Af^J 
CEVUriJN 

0.2121 
0.2121 
■" 0.4243 



VALUE 

3.dOUU 
3000 
1.2000 



4AX{:iUM 
VALUE 

4. lOJO 
3.6000 
1.3000 



1940 X 
OYOOl 0103 



STO SKAOR 
OF .4EAN 

0.1300 
0.1300 
0.3000" 



C.V. 



3.370 
3.892 
"28.284" 



pR>i n 



26.33 0.0242 
36.33 0.0175 
" 5^.00""" 0.1237 



— or- 
cn 



ro 

-Ul 



VARIABLE 



REA0GE5 
REA0CE6 
— ffEA*JCA'nr 



36 

"56" 



MEAN 



4.9643 
3.9304 



iy7^66"r 



SFANUARU 
CEVUriON 



1.7995 
U0231 

T761J5'" 



READING 
STUDENTS aEKE NUT FUTCREO 



VALUE 



2.4000 
4.0000 

'*a.3Coo 



HAXI.4UM 
VALUE 



13.3O0G 
7.9000 
3.9000" 



SrO ERROR 
OF MEA.N 



0.2405 
0.1370 

■0;2T56- 



c.v« 



36.250 
17.286 
T6r.0l6~ 



PR>|T| 



20.64 0.0001 
43.29 0.0001 

"4.48 o;ooor 



a> m 

a. 



XVARIAOLfc N 

00 

LANCUE3 21 

LAt^GSbo 21 

-LANCGArN - - 21 



I4EAN 



4.60^8 
5.7619 
0.93.1 



STANDARD 
UEVIAMUN 

1.3829 
1.2420 
l.llol 



LANGUAGE 
STUQE.M \i iilIKE fUTOKCO 



MI.a.MUH 
VALUE 

3.a0o0 
4.3000 
••0.3JO0 



HAaI.'^UM 
VALUE 

9. 7000 
6.9000 
3.7000 



SFD ERROR 
OF MEAN 



0.3018 
0.2710 
0.2433* 



C.V. 



28.782 
21.535 
ri6.602 



15.92 
21.26 

""r.93" 



pR>l ri 



0.0001 
0.0001 
070008 



VAR1A8LE 



LAN6GE5 
LANGGE6 
■rorOo Al R 3o 



3o 
36 



4.7917 
6.3839 

"175972 — 



STANDARD 
CEViATluN 



LANGUAGE 
:>TUQfcNrS wbfiE i><UT TUTORED 



1.1960 
1.3371 

173513 



VhLUE 

2.6000 
4.6000 
-2.0OOO 



MAX I HUM 
VALUE 

8.6000 
11. 1000 
4.8000* 



STO ERROR 
OF MEAN 



0.1993 
0.2562 



C.V. 



24.961 
24.059 
^84.603" 



PR>|T| 



24.04 0.0001 
24.94 0.0001 

"7;o9" ~o7ooor" 



fD O 

ro 2 



CJ CO 
' t — 



ERLC 
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SCIGEo 



I 

2 

'I 



TITLC Vn PRJGkA.H SA-JY002 a40l 15:04 TUESDAY, JANUARY 27, 1987 

BARBdS86 « 5A!> OA TA ^GT - I r3S & T\P FC<1 i9d5 C 1986 X 
rOTOT CATA 3ET BYUOI DIGS 



MEAN 



7.4000 
1500 
"j;75JO" 



irANOAKJ 
OEVIATION 

2.4042 
0.2121 



SCICNCl 
ST-JUbiJTS rttJlE rurUKirO 



VALUE 

5.7000 
3.1)000 
-I.IOOO 



MAXI.iUM 
VALUE 

9. 1000 
8.3000 
2.6000' 



STO EKKOR 
OF MEAN 



1.7C00 
0.1500 

~f7dS0(r 



c.v. 



32.489 
2.603 

"T43Tdi9" 



co- 
ot 



PR>|T| 



4.35 0.1438 
54.33 0.0117 
0.41'" 077548 



VAHIABLE 



SC1GE5 
SCIGE6 

scrjATir 



MEAN 



6.9C00 
7. lOUO 

"OVZOOO"" 



SCIENCE 
STUDENTS tTEimujT TUTORED 



standard 
i:eviation 



m 

•—I 
X 

CO 



2.0869 
2.0809 

'Z.6702- 



MINIMUM 
VALUb 



.4AXIHUH 
VALUE 



4.0000 
3.9000 
-3. 7000 



9.7000 
9.0000 
3.<f000" 



STD ERROR 
OF HEAN 



0.9333 
0.9306 

"nr947 



C.V. 



PR>|T| 



30.244 
29.308 

r3r3 5-7103- 



7.39 
7.63 

"07 17 



0.0018 
0.0016 

"0.8751" 



I2I 



erJc 



n> O 
U) 3 



o 3 

U> CO 
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LA PRUEBA RIVERSIDE de REALIZACION en ESPANOL 



Purpose 



La Prueba Riverside de Realizacion en Espanol (Prueba Riverside), an assessment 
appropriate for Spanish speakers, is thought to be a better measure of the 
academic achievement skills of those LEP students who have little English and 
are receiving instruction in Spanish than the English ITBS/TAP. It was 
administered to provide information concerning: 

Peclslon Question Dl ; Should the Title VII program be continued as it 
is, modified, or discontinued? 



Evaluation Question 01*3 . Did those project participants receiving 
instruction in bpamsn exhibit significant gains in their Spanish 
language scores? 

Evaluation Question Dl*4 . Did those project participants receiving 
bilingual Instruction in content areas exhibit achievement gains 
when tested in Spanish? 

Infonaatlon Neei} 12 . Did the project meet its objectives? 



During October and November of 1985, the Prueba Riverside was administered to 
project students in grades 7 and 8 at Murchison by the TBE teachers. The 
project specialist administered the Prueba to project students in grades 9 and 
10 at Travis. These results provided the baseline for comparison with the 
April -May of 1986 re-evaluation scores, 

Hispanic students in the bilingual and transitional programs at their respec- 
tive schools function with varying proficiency in two languages. Therefore, it 
was dssumed that their Spanish fluency would generally not be as proficient as 
Spanish monolingual speakers. Subsequently, on the Prueba students were 
assigned to a test level designated as "low average or below average." The 
only exceptions to this were the tenth graders at Murchison who were tested out 
of level because the test ceiling was ninth grade. Students were given the 
following levels: 



*Due to an error in test administration, seventh graders were given Level 13 
first semester. This needs to be taken into account when considering 
test/retest reliability. 

Because Prueba Riverside has only spring norms, students* raw scores were use(' 
to compare achievement gains. Only those students witn both spring and fall 
scores were included. 



Procedure 



Grade 



Level 

13 
14 
14 



T 
8 

9 

10 



;. ERIC 




APPENDIX C 128 
2 
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Prueba pre-and posttest scores were keypunched and entered into SAS data 
files, SA-BYOOl-0102 and SA-BYOOl-0102 (Attachment C-1). Only those students 
who had both pre-and posttests were included in the final sample. In 
November, 1986, the programmer ran a SAS PROC SORT of LEP A & B students at 
Murchison and Travis. The percent of those students making gains in the 
subtest areas were hand calculated. Files were merged to create SA-BYO03-0301 
so gains could be reviewed. A PROC MEANS was included in this program to 
examine significance. 

Results 

Evaluation Question pl-3 . Did those project participants receiving instruction 
in Spanish exhibit significant gains in their Spanish language scores? 
(Murchison and Travis only) 

As can be seen below in Figure 1, significant (.05) or highly significant 
(.01) overall gains were found in all subtest areas. 



VARIABLE 


H 


MEAN 


PR >T 


Reading 


91 


1.14Z9 


.0106** 


Language 


92 


.9565 


.0153* 


Mathematics 


93 


1.4301 


.0004** 


Social Studies 


92 


.8370 


.0494* 


Science 


92 


1.2174 


.0023** 



Figure 1. LA PRUEBA RIVERSIDE RAW SCORE MEAN 
GAINS. T-tests were run to check 
pre-to posttest gains for 
significance. 



* = Significance at the .05 level 

of probability 

* = Significance at the .01 level of 

probability 

Thus, the objective as stated was met. 

It is Interesting to note that when the schools were examined separately, 
Murchison project LEP students made significant gains in all areas except 
social studies. Students at Travis, however, did not make significant gains. 
(See Attachment C-1). This discrepancy may be influenced by the difference in 
programs at the two schools. At Murchison students are enrolled in an 
intensive Transitional Bilingual Education Program whereas students at Travis 
participated in a new ESL/content area support program. 
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Evaluation Question Dl-4 > Did those project participants receiving bilingual 
instruction in content areas exhibit achievement gains in those content areas 
when tested in Spanish? (Murchison only) 

When the students • pre- and posttest scores were looked at by content area, 
the percentage showing gains in raw scores was: 



It should be noted that language scores of the Prueba Riverside de Realizacion 
en Espanol (Prueba Riverside) were examined instead of the Spanish LAB, 
because the Spanish LAB testing was not administered in the spring to prevent 
over-testing of students. It is not known whether this substitution made the 
objective more difficult to meet. 



Reading 

Language 

Mathematics 



58% 
58% 
64% 



Social Studies 
Science 



57% 
55% 
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FILE 10 AV .^ 

COMMENTS 



CARD Kii.i' 



LOCATION 0 /t.fcr 
DATE t'^^^ 1 ^) / 



> 

m 
o 

X 

o 



FIELD 


COLUfi/INS 


I' ESCRlPl lOIJ 


A 


_i:_2_ 






^ '/O 






// ^cJ 












3l -35' 




—I 


-1/ • <y 


y Att) />uec?Q /J / cc^ 5' ere- 












If sj i€ ' * 


1 














rV - 7^ 










. 




r A ^CUJ^ nil >^ U G r^-d y 










S'l -S3 
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I S A S LOG VSE SAS 82.4 ^SE 3.1 JOB EVISASdY 
NUIfcl ThC jga eVlSA^BY HAS n££IAJiiJN^NQ£K.-H£L£AiE^2^^aL^AS 



U:il TUESOAYi OECEf'BER I6t 1986 



AT AUSTIN l/^JEPENDCM SCHOUL l)l:>rKlCT (Ji9b600n« 
NaTfc> CPUli) WERSICK ^ ff- SERIAL ^ 013653 MJDFt » 43^1 , 



00 



NOTE: NU UPTiaN:> SPECIFIEO. 



ro 



OPTIJUS EKRUKS « 0; 
TITLt TITLE Vll PROGRAM 



4 

! 5 
6 



TI?L£2 PKUEtiA - PRE (FALL I9d3i 
TiTLEi PKUEBA - PCST (SPRlNvi 1986) 
TITLE4 rUTLR DATA FILE 



SA-QY003 030 1; 



SA-OYOOl 0102; 
SA-dYOOl 0103; 
_SA-BY00l 0105; 



> 
m 

I— 4 

X 

o 



1 J B 


OATA oARBFlLl ; 






,9 


INPUT f iLEilj 


$ 1-3 




10 


SlUlO 


S 4-10 




11 


STJNAME 


S 11-30 




' 12 


GRACE 


$ 31-32 




13 


SCHOOL 


S 33-35 




• {14 


KEAJ 


36-37 




15 


LANG 


i8-39 




1 16 


MATH 


40-41 






tOf^P 


42-43 




1' 18 


SOCST 


44-45 




!' 19 


SC 


46-4 7 






COMPREH 


4tJ-50 




21 


V0CA8 


51-53 




! 22 


^OKKSTU 


54-56 




23 


«57 PRLENG 


Z02. 




' 24 


a59 PuSTENG 


Z02, 





125 
126 
J27 



if 



£61 P<ESPAN 
£63 PGSTSPAN 
SCHOOL » '007' 



OR 



2d 
29 
30 



If OKAUE GE 
KEEP STJIO 
CARDS; 



Zl)2. 
Z02.; 

SCHOUL « 



•052»; 



•07» AND oRAJE L£ ' 10» ; 
SCHOOL GRADE READ LANG 



MATH SOCSr SC STUNAMEt 



0C000130 
00000140 
00000150 
00000160 
00000170 
00000180 
0C000190 
00000200 
00000210 
00000220 
00000230 
00000240_ 
00000250 
00000260 
00000270 
' OC000280 
00000 290 
00000300 
00000310" 
00000320 
00000 330 
00000340 
00000350 

ooooq36q_ 

0Cd00370 

00000360 

00000 390_ 

00000400 

00000410 

00000420 



note: invalid DATA FOR PtSTENG IN LINE 31 59-60. 
note; invalid data FCR PCSTSPAN in line 31 63-64 • 



24:il 
26:31 



NOTE: 



FJRTriER tRKORS CF IrilS TYPE HILL NOT BE PKINTED. 
U^TIJNS ERRORS-NN; ♦ LIMIT REACHED. 



rule: 



31 



1234567 101234567 201234567 30l2345o7 ^01234567 501234567 601234567 701234567 80 



no rf- 
Q) rl- 



AVW1330J01CASTR0tRAFAEL 



, 12003 • • 83 J?0 000000 10 

u'FIlEIO^AVW SIUiJ=liJ0J01 STUNAME«CASTP.0. RAFAEL GRADE- 12 SCHO^L*Oor^E AOTTTAN^S^MAT H^COMP^ 
VJCAd=. WURKSTU=. PREtNG=8i POSTENG* ._ERESPAN=90 PCSTSPAN=. ^ERRQR =1 N =1 



"^0CS1=. SC=, CGMPREH= 



note; UATA set oSER010,dARBFILl HAS ClBO^USSER V AT I JNS AN O 9 VARIABLES* 104^ UBS/TRK. 
NOIE: the data STATE^'£NT USED 5.93 SfcCONOS AND 330K. 




249 

750" 

251 

} Z'jZ 



PKut SUkI ; 

BY STUlO; 



00000440 
00000450' 
00000460 
00000470 



MAkNI.^G: 



SCkTSiZE VALUE IS LESS THAN THE MIi>:l..JUM 
KEUUIRED BY YUJR SYSTEM SORT UTILITY, 



13' 



S A S LUG VSE SAS 82.4 



VSE 3.1 JOB EVUASBY 



11: 11 TUESOAYt OECEKBER 16» 1986 



Tug ^UkT UTILITY MAY TERMI NATE AB NURMAt LY. 



iitOTE: DATA SET USER010.8AABF ILl HAS 180 OBSERVATIONS AND 9 VARIABLES. 104 08S/TRK. 
JHt PKCCcOUKE SCRT USED 18.34 SECONDS AND 292K. 



00 



253 
254 
255 



OaTA dAR&Fa2; 

INPUT flLE :0 

STUl J 



S 1-3 
S 4-10 



00000480 
00000490 
00000500 



25o 
257 

i5a_ 



REA02 
LANG2 
HATH2 



36-37 
38-39 
40-41 



00000510 
00000520 
00000530 



259 
260 



C0HP2 

SCCST2 

SC2 



42-43 
44-45 
46-47; 



2o2 



CARDS; 



00000540 
00000550 
00000.560 
00000570 



NOTE; UATA SET USEKQ 10>BARBF IL2 HAS ^6 OBSERVATIONS AND 6 VA R IABLES ._ J,2 8 CBS/TR Kj 
note: the DATA STATt^MKNT USED 4.bl SECONDS AMD 306K. 



409 



00000590 



\ 410 
411 

I 412 



PRDC SORT; 
PY STUID; 



00000600 
00000610 
00000620 



llWAKNiNG: SCRlSiZE VALUE IS LfcSS THAW THE MINIMUM 
' : RLWUIKED BY YOUfs SYSTEM SORT UTILITY. 



THE ;>aRT UTILITY MAY TERHilOXZ. ABNORMALLY • 
' NUTb: DATA SET USER0I1.0ARBF IL2 HAS (l46)06SERVAT lOrji AND 6 VARIABLES. 128 OdS/TRK« 
NOTL: The HkUCEDUKE CRT USED 2U39 SECONDS AND 292K. 



i 4lJ 

* 4U 



i 415 
• i 416 
[ ' 417 



< 41J 

i 4U 

M 420 
n 421 

' = i 422 
' 42i 



U vTA bARdFlLl ; 

'tcKGEaARCFIL 1 



( IN = INFILI) 



BARLFIL2 i IN > INFIL2); 

BY stuid; 

IF li^FILl = 1 AND ILF1L2 = l; 



0000063C 
_000^^40 
00000650' 
00000660 
00000670 



REAuO - READ2 - READ; 
LANGb > LANG2 - LANG; 
MATHG * MATH2 - MATH; 



6UCSTG = SGCST2 - SUCST; 
SCv> - St2 - sc; 



424 

NuTl: .Hl:>SUiG VALJEi .^ERE GENERATED AS A RESULT OF PERFOR.^I.MG 



00000680 
00000690 
^0000700 

oddoono' 

00000 720 
0000C730 
'0d000740" 



AN OPERATION ON MISSING VALUES. 

EACH PLACE IS GIVEN bY: (NUMBER LF TIMES) AT (LINE) : (COLUMN). 



li AT 41o:l3 12 AT 419:13 iO AT 4«i0:13 11 AT 421:P« 11 AT 422ai 



-O rt 

zr 
ro 3 

_cx._n_ 



; NuTt : 


DATA SET USEK0l0..3Ai<aF ILl HAS( 


I2a'0aSERVATlGNS AND 21 VARIABLES* 46 


.. NOTE: 


THE OATA STATEMENT USED 3.81 S 


ttLND:> AND 30oK. 


•i 425 


DATA BARBFIL2; 




. 42o 
.j 427 

ri 42(i 


iNk'OT SCHOOL 
GRADE 
STUID 


1-3 
i 5-6 
S 8-14 


. 429 


STUNAME 


$ 16-35 



— ro" 



SEMESTER 
TOTKEAD 




00000_750_ 
^0Mb760 
00000770 
q^0000 780_ 
00000790 
00000800 
00C00810 



-JO 



> 

m 
00 z 
o 

X 

o 



0 

o 
o 

9 



Ai2- 



S A S L u G VSE 3AS 82.4 
^45 LLlLAliG 



VSE 3.1 jca EVUASav 



UUl TUESOAYt OECE^eEft I6t 1986 



433 
434 
4i» 



S50 TUTMATH 
•35 TtTSUCST 
>60 TbISCI 



ZD4.2 
ZJ4.2 
Z34.2S 



.oooooe20_- 

00000830 
00000840 
00000850 



4i6 
437 



KEEP STUlO; 
CAKi)S; 



00000860 
00000870 



; note: 

note: 
NJTC: 
njuTET 

• NuTfc; 



INVALiO JATA 
INVALID DATA 
' UVALia JATA 



f-liR 
FOii 

ICR 



TLTREAO 
ToTL'iNG 
TLTrtATH 



IN 
IN 
IN 



LINE 
LINE 
LINE 



438 
436 
438 



40-43. 
45-48. 
50-53. 



4il:3l 
432:31 
433;31 



iUVALIO U4TA hLR TLISuCST IN LINE 438 55*-38. 434:Jl 

IKVALIO DATA FUR TLTSCI IN LINt 4jb 60-63. 435:31 

FURTHER EKKOKS GF THIS TYPE n ' >.L.*'i^LJiE_Pk I N TED., . 

UPTIJuS bKRuRS'Ni*; ♦ LIHIT .HdD. 

KULEl I^34bo7 101234567 20123 4567 301 234507 4 01234567 5CiI23<r^i^7 60123.456T„7a 1 234567 80. 



438 3 09 1957321 OELECN HARTA 

SCH0JL=3 iRMDEg09 i TUIU^ 1957321 STUKAHE^OELeUi; MARTA SEMESTER* 



TUTREAO^ 



COOOOOlO 
TUTLANG=. TUTHATH=. TUTSQCST=. 



TU1SCI=. 



'_£KRaK««l «N«»l 

|nOTc: OATA set US£k010.8A.<DFIL2 HAS* 167^ OaSER VAT IONS ANO 1 VARIABLES. 726 03i/TKK. 
hjOTE: ?HE DATA STATEJ^ENT tSEC 4.62 VtCfiNUS ANJ 306K. 



605 



K 6Jo 



Pf<jc sort; 



f 607 

i < 608 
' • 609 



DY SlUiO; 



00000890 
0C00090C 
00000910' 
0C000920 
00000930 



WAK;iU;S: SORTSIZE VALUE IS LESS THAN THE MENI^IUM 
KEwUlREJ fey YOJR SYSTEM SORT UTILITY. 



THE SORT UTILITY MAY TERMINATE AdNORHALLY. 
NOTt; OaTA set USER010.BA.^BFIL2 has 167 OBSERVATIONS ANO 1 VARIABLbS. 726 OBS/TRK. 
NOTE: THE PKOCEDJRE SORT USEC 15.15 SECONDS ANO 292K. 



610 
611 



OATA dARdFILl; 
INFILX = c; 



612 
613 
614 



4ERGE 8ARBFIL1 
BAR6F1L2 
STUIO; 



( IN 
( (N 



INFILl) 
1NFIL2); 



UY 



615 
t>16 
617 



IF INFILl > 1 ANO INFIL2 « 1; 



00000940 
00000950 
00000960 
00000970 
00000980_ 

6bo6'099d 
ooooicoo 

00001010 



0) 



NOTE: DATA SET USERO 10 . DAKBF ILl HASCi^^DSER VAT IONS AND 21 VARIABLES. 46 OBS/TRK- 
NjTE: THE UA^A STATEMENT USEO 4.32 SECONDS aNO 306K. 



a> o 
CO 3 



618 
619 

"6l0" 



PACC ^UkT; 

BY SCFOuL GRACE STUNAPE; 



00001020 

0CU01C3q^ 

00001040 



O 3 



cn o 



MARNINO: SOKT^IZE VALUE IS LESS THAN THE MINIMUM 



KtWJlKtO dV VJUH SYilbM ^UKI OriLlTV. 
THE iORT UTILITY MAY TERMINATE AB.^ORMALLY^ 
. NOTE: 3ATA SET JSERO 10.3ARBF ILl HAS 100 OBSERVATIONS AND 21 VARIA3LES. 46 OBS/TRK. 



NUTL; THE PkCCEOURE SORT U^EC 19. Oo SECuNOT^Nt) 292Kr 

621 PKCC print; 



00001050 



5^ . 



m 
vo z 
o 



i 








TITLE 


vu 


PROGRAM 


SA-BY003 0301 


llsll TJESCAYf DECEMBER 16. 


1986 4 










PRUEBA « 


PRt 


(FALL 1985) 


SA«BY001 


0102 
















PRJEBA - 


POST 


(SPRING 1966) 


SA-BYOOl 


0103 








• 








TUTOR DATA FILE 


SA-BYOOl 


0105 









t VARIAdti: 


N 




KEAN 








MAXIMUM sro ERROR 


CV. 


T 


PR>|T| 

- 










CEVI ATiUN 




VALUE 


VALUE 


OF MEAN 






' RtAU 


91 




16*4066 


7. 9UOW 






29.0000 


0.60B8 


35.400 


26.95 


0.0001 


j READZ 


IGO 




17.31U0 


5. Bl 13 




5.0000 


29.0000 


0.5811 


33.572 


29.79 


0.0001 


> READG 


91 




1.1429 


4.17!>5 




•19.0000 


10.0000 


0.4377 


365.353 


2.61 


0.0106* 




92 




11.9457 


4. 53B9 




1 0 ii n n 


20.0000 


0.4732 


37.996 


25.24 


0.0001 


; LA.\G2 


100 




12.7800 


4. Id4l 




k m 0000 


21 •0000 


" 'b.4l84 


32.739 


3C.54 


0.0001 


1 ' LA>ii»o 


92 




0.9565 


3.71 19 




•12 .OOLO 


13.0000 


0,3670 


388.064 


2.47 


0.0153 - 


• MAFh 


94 




15.3617 


4.75ol 




6.0000 


25.0000 


0.4906 


30.961 


31.32 


O.COOl 


MAJH2 


99 




16./475 


5.1237 




7.0000 


28.0000 


0.5 149 


30.594 


32.52 


0.0001 


j-;NA)nG 


93 




1.4301 


3.74B6 




•15.0000 


13.0000 


0.388/ 


262.121 


3.68 


0.0004-> 


1 ; soc^r 


93 




14.1505 


4.9B46 




3.0000 


25.00U0 


0.5169 


35.226 


27.38 


0.0001 


[• S0CST2 


99 




14,9293 


5 .0U66 




2.0000 


25.0000 


0.5032 


33.536 


29.67 


O^COOl" 


1 < SLiuSlu 


92 




U.8370 


4.0309 




•17.0000 


11.0000 


0.4202 


481.610 


1«99 


0.0494. 


• * sc 


9i 




13.6o22 


4.6bl5 




3.0000 


23.0000 


0.4354 


34.417 


28.02 


0.0001 




99 




14.O970 


5.1754 




i.OOOO 


'^25^0000" 


0.520f 


35.214 


" 26.26 


O.OOOl' 




92 




1.2174 


3.717to 




•lo.ooco 


13.0000 


0. i8 76 


305.372 


3.14 


0.0023 - 


W fWTL: THE 


PRLwEOURE 


MLANS USEO 3.50 


SECONDS AiNO 350K ANO PRINTED 


PAGE 4. 










1 b3i 


PROC MEAN 


:> HAX0£C«4 N 


KEAN STD 


KIN 


MAX STDERR 


CV T PRT; 


J0001170 










/Afi 


KCAO 


REAU2 


REAOO 








OOOOl 180 








n i~n 

i 63!) 




LANG 


LANG2 


LANGG 








00001 190 








• 1 oJo 




MATH 


MATH2 


MATHG 








00001200 








H 637 




SOCST SCCST2 


SOCSTG 








00001210 








I ' 63 a 




SC 


SC2 


SCG; 








00001220 








li 


UY SChOUL 


t 










00001230 








!> 640 
















00001240 









CO 



m 



133^ 





-a rf 

Qi rf 

•m n 

or- 

4^ 3 

o 3 
-h ft 



TITLb Vli PHUGRAH 
PHUEBA - PRE <FALL 1985) 
PRJEBA - PJSr (SPi^lNG 19a6) 



VARIAQLE 



MEAN 



TUTOR DATA FILE 
STANDARD 



SA-BY003 0301 ll:ll 

SA-BYOOl 0102 
SA^HYO Oi 01 0 3 



TUESOAYf DECEMBER I6t 1986 



MINIMUM 



SA-OYOOl 0105 
MAXIMUM 



CEVIATION 



VALUE 



VALUE 



STO ERROR 



C*V. 



OF MEAN 



PR>JTI_ 



00 



ro 



REAO 
RCA 1)2 



I KEAUu 
' LA.4G 
LA ixiZ 



12 



21.3J33 
20.8667 



LANJG 

MaTH 

MATH2 



12 
13 



li 
li 
15 



0.1o67 
U.2jOd 
15, 2000 

0.7o92 
17.1538 
13.3333 



5.5487 



2.65 72 
3.8977 

_3..3dittL 
2.6I9J 
6.1332 
6.2183 



MAJKG 

soc:>T 

Si;C:>T2 



13 
12 
15 



0.9231 
15.9167 
17.2000 



4.0510 
5.4349 
5.3211 



U.OOCO 

9i000(L 

-5.00C0 

a. 0000 

^10.0000 
-3.0000 
7.0000 
^7. 00 OA 

-o.ouoo 

6.0000 
9.0000 



OZ'J 



iOCSK 

SC 

SC2 



12 

12 
15 



1.5000 
17.8333 
18.0000 



3.34J9 
4./065 
5 . U 30 



-5.0CU0 
9.0000 
8.0000 



StG 



12 



0.5000 



2.3549 



-3.0000 



28.0000 
^29.0000, 
6.0000 
20.00UJ 
,21.0000 
b.COCO 
25.00GO 
„2 6^000 

a. 0006 

23.0000 
J4. OJOO 

7rdooo" 

22. OOOJ 
J5.J)000_ 
'<t.0Qc6 



1.6018 


26 .009 


13.32 




1.5 580 


28 .917 


1 3.39 




0» 7o71 




r 77 


0.8320 
0. 0001 


1.0810 


27. 389 


13. 16 


0.8740 


22.269 


17*39 


0.0001 


0.7264 


340.465 


1.06 


0.3104^ 


1.7016 


35.766 


10.08 


0.0001 


1.6055 


33.918 


1 1.42 


0.0001 


1.1235 


^;38.854 


C.82 


0.4273^ 


1.^689 


34. 146 


10.15 


0.0001 


1.3739 


30.937 


12.52 


O.OCOl 


0.9653 


222.928 


1.55 


0.1485^" 


1.3587 


26.392 


13.13 


0.0001 


1.3202 


28.406 


13.63 


0.0001 


0.6 793" 


4 70.976 


C.74 


'0.4774\L 



SCHuOL=052 



REAO 
REAU2 



7^ 

35 



15.6582 
16.6824 



ki:AOG 

LANG 

LANG2 



5.5026 
5.5746 



5.0000 
5.0000 



79 
79 

85 



1.2911 
11.5690 
12.3529 



4.3535 
4.5480 
4.1825 



4LANGG 

MATH 
A MATrl2 



'-19.0000 
I. 0000 
^t.GOOO 



29.0000 
_26.J)000_ 

10. do ob 

20.0000 
21.0000 



79 
81 
84 



0.9873 
15.0741 
16.4643 



3.8746 
4.47/1 
4.8927 



•12.0000 
6.0000 
8.0000 



MATHU 
sue ST 

socst;^ 



80 
31 
54 



1.5125 
13.8889 
14.5238 



3.7179 
4.8964 
4.8706 



>15.0000 
3.0000 
2.0000 



SUCSTG 

SC 

SC2 



80 
81 
84 



0.7375 
12.9753 
14.1071 



4.1331 
4.3o74 
4.9892 



-17.0000 
3.0000 
3.0000 



1 j.OOO 
24.0000 
28.0000 

r3.6ooo 

25.0000 

J.5.oqoq_ 
if. 000 b 

23.0000 
25.0000 



SCG 80 1.3250 3.8804 -lU.OOCO 13.00C6" 
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CRITERION-REFERENCED TEACHER COMPETENCY CHECKLIST 



Purpose 

A criterion-referenced teacher competency checklist was developed and 
administer d to provide information concerning: 

Decision Question Dl : Should the Title VII program be continued as it 
1s, modified, or discontinued? 

Evaluation Question Pl*7 . Did high school teachers participating 
In the tSL endorsement training program demonstrate improvement in 
required competency areas? 

Infomation Need 12 > Did the project meet its objectives? 

Participating teachers will master at least 85% of the 
project-related staff development skills presented to them during 
endorsement training sessions as measured by teacher competency 
checklist and university endorsement course examinations. 



Procedure 

A criterion-referenced teacher competency checklist called the Teacher Self 
Inventory was developed by the Office of Evaluation and Research staff in 
coordination with the project director and project specialist. See Attachment 
D-1. It was administered as a pre- and post self-inventory of teacher 
competency in the instruction of LEP students. The Teacher Self Inventory was 
administered twice during the second course in the projected four course ESL 
endorsement series. The pretest was administered at the first class meeting in 
January, and the posttest was given during the last class session in April, 
1986. 

The Teacher Self Inventory was not administered during the first course in the 
ESL endorsement series because the course focused upon language development 
and acquisition. The self-inventory was thought to be a more appropriate 
measure of teacher adaptation of the second course's content which dealt with 
ESL methodology and its application to the classroom. 

Specific ways in which the achievement of objectives were measured by the 
teacher survey and endorsement course grades will be discussed under results. 
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Results 

Evaluation Question Dl-7. Did high school teachers participating in the ESL 
endorsement training program demonstrate improvement in required competency 
areas? 

In order to answer this question, the results of the Teacher Self Inventory 
were looked at in three ways. First, a frequency of response was calculated 
for each of the 12 items on the pre- and post-survey with corresponding 
percentages tabulated for each frequency. Second, the mean response for each 
item was computed with SAS. Third, the means on the pre-versus post-survey 
items were tested using the General Linear Models regression procedure of the 
SAS statistical package SA-BY003-01-01 in the EPIN library. This provided a t^ 
test of differences In means. 

It should be noted that it was not possible to match individual teachers* pre- 
and postratings because teachers responded anonymously. Therefore, the mean 
represents the average of the composite loadings of each of the twelve items. 
The comparison made is between the two groups' (pre- and post-survey) average 
item response. The reader is cautioned that 4 more people filled out pre- 
surveys than post-surveys. It is possible that these respondents were more 
negative or positive than the rest of the group initially. The reader should 
also be cautioned that with the small N, it is more difficult to obtain 
significance. 

There was a positive pattern of movement between the pre- and post-surveys. 
(See Figures D-1 and D-2.) The means increased for 11 of 12 items. However, 
regressioh analyses revealed these differences were significant in only two 
cases (items 5 and 9). 

0 Item #5— On the post-survey, 46% more respondents felt that their 
organization of instruction was adequate to meet the needs of LEP 
students. Those who disagreed decreased by 43%. This finding was 
statistically significant. 

0 Item #9— On the post-survey, 20% more respondents felt they were able 
to use audiovisual equipment effectively to augment LEP student 
learning. Those who disagreed decreased by 35%. (Those who were 
neutral increased by 15%.) This finding was statistically significant. 

Some of the interesting patterns of movement found were: 

0 Item #1— On the post-survey, 26% more respondents felt prepared to teach 
LEP students than on the pre-surveys. Those with neutral feelings 
decreased by 28%. 

0 Item #4~0n the post-survey, 18% more respondents saw themselves able 
to respond to LEP students' language needs. Those who were neutral or 
disagreed decreased by 20%. 
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0 Item #6~0n the post-survey, 44% more respondents saw themselves as 
adequate in helping LEP students stay on task. Those who were neutral 
or disagreed decreased by 45%. 

0 Item #10— On the post-survey, 30% more respondents felt that they 
employed varied and student-appropriate evaluation strategies when 
assessing students. Those who were neutral or disagreed decreased by 
31%. 

Based on an item by item consideration, almost three-quarters of the teachers 
as opposed to less than half before, now feel prepared to teach LEP students. 
In addition, at least 70% of the posttest respondents also see themselves as 
competent in working with LEP students in terms of: 

0 responding to specific language needs, 

0 helping students stay on task, 

0 making content area relevant and useful, and 

0 developing appropriate objectives. 

Information Heed 12 . Did the project meet its objectives? Participating 
teachers w1 1 1 master at least 85% of the project-related staff development 
skills presented to them during endorsement training sessions as measured by 
teacher competency checklist and university endorsement course examinations. 

In order to measure achievement of this objective, first the teacher self 
inventories (teacher competency checklists) were looked at individually. Of 
the 14 teachers responding, 6 reported feeling competent on 85% of the items 
(agreed or strongly agreed). It should be noted that 83.3% was the actual 
criterion used as it represented 10 out of 12 positive responses. Thus the 
objective was not met as stated based on this measure. 

Next, course grades for the project teachers were examined. A grade of "A" or 
"B" was used as the criterion for determining a mastery level of at least 
85%. Of the 17 who completed the course, 10 or 59% met the criterion for 
staff development skill mastery. This also does not provide support for 
achievement of this criterion. 

According to these data, project teachers are increasing their ESL 
instructional skills after two courses in the projected four course ESL 
endorsement series. However, as a group, they diu not meet the projected 85% 
mastery level. 
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1. I feel prepared to teach LEP students. 



Pre-survey Post-survey 
TFTT N=14 — 



Response Number of Responses Number of Responses 

Strongly Agree 6 (35%) 5 (36%) 

Agree 2 (11%) 5 (36%) 

Neutral 6 (35%) 1 (07%) 

Disagree 3 (18%) 3 (21%) 
Strongly Disagree 
No Response 



2. I am comfortable teaching my content area to LEP students. 

Pre-surve y Post-survey 

N=i7 N=14 — 

Response Number of Responses Number of Responses 

Strongly Agree 3 (18%) 6 (43%) 

Agree 9 (53%) 4 29%) 

Neutral 2 12% 1 (07%) 

Disagree 2 (12%) 1 (07%) 

Strongly Disagree 1 (06%) 1 (07%) 

No Response 1 (07%) 



3. I am able to elicit class participation from my LEP students. 

Pre-survey Post-survey 

TFTT N=i4 

Response Number of Responses Number of Responses 

Strongly Agree 3 (18%) 3 (21%) 

Agree 6 (35%) C (36%) 

Neutral 5 (29%) 5 (36%) 
Disagree 

Strongly Disagree 

No Response 3 (18%) 1 (07%) 

Figure D-1. ITEM BREAKDOWN BY NUMBER AND PERCENTS ON THE PRE-AND 
POST-SURVEYS. (Page 1 of 4) 
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4. I am able to respond to LEP students' language needs. 

Pre-survey Post-survey 

N=17 WIT^ — 

Response Number of Responses Number of Response? 

Strongly Agree 4 (24X) 3 (21%) 

Agree 5 (29X) 7 (50%) 

Neutral 2 12% 2 14%) 

Disagree 2 (12%) 1 (07%) 

Strongly Disagree 3 (18%) 1 (07%) 
No Response 1 (06%) 

5. My present organization of instruction is adequate to meet the need: 
of LEP students. 

Pre-survey Post-survey 

N=17 N=14 — 

Response Number ot Responses Number of Responses" 

Strongly Agree 2 (12%) 1 (07%) 

Agree 1 (06%) 8 (57%) 

Neutral 4 (24%) 3 (21%) 

Disagree 9 53%) 2 (14%) 
Strongly Disagree 1 (06%) 
No Response 

6. I can adequately help my LEP students stay on task. 

Pre-survey Post-survey 

N=17 N=14 — 

Response Number of Respolises Number of Responses 

Strongly Agree 2 (12%) 2 (14%) 

Agree 5 (29%) 10 (71%) 
Neutral 4 (24%) 

Disagree 6 (35%) 1 (07%) 

Strongly Disagree 1 (07%) 
No Response 

7. My instruction of the content area is relevant to and useful for 
LEP students. 

Pre-survey Post-survey 

N=17 N=14 — 

Response Number of Responses Number of Responses 

Strongly Agree 3 (18%) 5 (36%) 

Agree 7 41%) 5 36%) 

Neutral 4 (24%) 3 (21%) 

Disagree 1 (06%) 1 (07%) 
Strongly Disagree 2 (12%) 
No Response 
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8. I can adequately design objectives appropriate for the needs and 
achievement of my LEP students. 



Pre-surve: 
TFT7" 



Response 



l>»jm ber ofl^esponses 



Strongly Agree 
Agree 
Neutral 
Disagree 

Strongly Disagree 
No Response 



2 (18% 

7 (m 

4 (24%) 

1 06% 

2 (12%) 



Post-survey 
N=14 — 

"Num&er OT Kespouse? 

5 (36%) 

5 (36%) 

3 (21%) 

1 (07%) 



9. I c^n utilize audiovisual equip.nent effectively to augment LEP 
£ udent learning. 



Pre-su rvey 
M7 



Post-survey 

wur^ — 



Response 



Number of Response?" 



Number of Re^nonses 



Strongly Agree 2 (12%) 4 (29%) 

Agree 8 (47%) 7 50%) 

Neutral 1 (06% 3 (21%) 

Disagree 5 (29%) 

Strongly Oisagree 1 (06%) 

No Response 

10. I employ varied and student-appropriate evaluation strategies when 
assessing my LEP students. 



Pre-su rvey 
N-17 



Post-survey 
N=14 — 



Response 



Number of ResponseT 



Number of Responses 



Strongly Agree 
Agree 
Neutral 
Disagree 

Strongly Disagree 
iio Response 



2 (12%) 

5 29% 

9 (53%) 

1 (06%) 



3 (21%) 

7 50% 

3 (21% 

1 (07%) 



Figure D-1. (Pa^^.' 3 of 4) 
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11. In terms of my instructional objectives, I am able to individualize 
activities appropriate for the special needs and achievement levels 
my LEP students. 

Pre-survey Post-survey 

N«i7 wir^ — 



Response 



Number of Responses 



Number of Responses 



Strongly Agree 
Agree 
Neutral 
Disagree 

Strongly Disagree 
No Response 



2 
5 
5 
4 
1 



(123;) 



(243;) 
(063;) 



2 (143;) 

5 (363;) 

6 (433;) 
1 (073;) 



12. I employ a variety of strategies to clarify instruction 

(e.g. modeling, audiovisual examples, whole group responses, etc.). 



Pre-survey 
N=l/ 



Post-survey 
TFT? 



Response 



Number of ResponseT 



Number of Responses 



Strongly Agree 
Agree 
Neutral 
Disagree 

Strongly Disagree 
No Respon^ie 



5 (2.93;) 

5 ^93; 

5 (293;) 

1 (063;) 

1 (063;) 



3 (213;) 

8 (573;) 

2 (143;) 

1 (O73;) 



Figure D-1. (Page 4 of 4) 
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Item 




Pre 


N 

Post 


Mean 

Pre 


Post 


1. 


I feel prepared to teach 
LEP students. 


17 


14 


3.53 


3.86 


2. 


I am comfortable teaching 
my content area to LEP. 


17 


13 


3.70 


4.00 


3. 


• 

I am able to evoke class 
participation of my 
LEP students. 


14 


14 


3.86 


3.71 


4. 


I am responsive to 
LEP students' needs. 


16 


14 


3.44 


3.71 


5. 


My present organization of 
instruction is adequate to 
meet the needs of LEP 
students. 


17 


14 


2.59 


3.57* 


6. 


I can adequately help my 
LEP students stay on task. 


17 


14 


3.18 


3.8C 


7. 


My instruction of the 
conter^t area is relevant to 
and useful for LEP students. 


• 17 


14 


3.53 


4.07 


8. 


I can adequately design 
objectives appropriate for 
the needs of my LEP 
students. 


17 


14 


3.65 


3.86 


9. 


I can utilize audiovisual 
equipment effectively to 
augment LEP student 
learning. 


17 


14 


o on 

3.29 




10. 


I employ varied and student- 
appropriate evaluation 
strategies when assessing my 
LEP students. 


17 


14 


3.47 


3.86 




*Items showing statistically significant gains. 







Figure D-2. AVERAGE FREQUENCIES FOR TEACHER SELF INVENTORY ITEMS. 
(Page 1 of 2) 
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Item N Rean 
Pre Post Pre Post 



11. In terms of my instructional 
objectives, I am able to 
individualize activities 
appropriate for the special 
needs and levels of my 

LEP students. 17 14 3.18 3.57 

12. I employ a variety of 
strategies to clarify 
instruction (e.g. m deling, 
audiovisual examples, whole 

group responses, etc.) 17 14 3.71 3.86 

The scale ranged from Strongly Agree (5) to Strongly Disagree (1) 
♦Items showing statistically significant gains. 



Figure D-2. (Page 2 of 2) 
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ADMINISTRATOR INTERVIEWS 



Purpose 

Administrator interviews were conducted by the evaluator to provide information 
concerning: 

Decision Question 01: Should the Title VII program be continued as it 
is, modified, or discontinued? 

Evaluation Question 01'-8. What concerns/strengths about the 
implementation of the project were identified by: 

a) Project administrator ? 

b) Campus administrators: 

Evaluation Question Dl-9. Was the program implemented as planned? 
Infonnatlon Need 12. Did the project meet its objectives? 



Procedure 

To address the evaluation questions associated with the Title VII program 
implementation and effectiveness, interviews were conducted with the project 
campus' administrators, the project director, and the project specialist. All 
interviews were conducted by the program evaluation associate in the offices 
of the staff. 

Separate interview forms for campus and project administrators were developed 
by the ORE staff to guide the interviews as shown in Attachments E-1 and 
Some questions were common to both. 

During March and April of 1986, campus administrators were interviewed at the 
four project schools. These were the principals who worked most closely with 
the LEP student population. However, when making the first appointments for 
interviews, the principals pointed out the key involvement and awareness of 
the staff member serving as the school's LEP coordinator. Therefore, it was 
decided to conduct the interview with both the admin ^trator and LEP 
coordinator present. 

The project director and project specialist were interviewed together during 
the month of May, 1986. 

Notes from the four campus interviews were paraphrased by the evaluation 
associate and recorded on a composite interview questionnaire (Attachments E-2 
and E-4). Confidentiality was provided by designating the campus interviews 
by "school number" and recording the project administrators' responses 
together. 
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Results 



Evaluation Question What concerns/strengths about the implementation of 

the project were Identified by: 

a) Project administrators? 

b) Campus administrators? 

Campus Administrator Interviews 

In general, the schools' administrators believed that Title VII was having a 
positive overall impact. Specifically, all noted positive gains in: 

• LEP student attendance, 

• Self concept and school attitude of LEP students, 

• Acquisition of English language skills and academic content of 
achievement of LEP students. 

In regard to the three program components: 

• All four schools thought the staff development component was 
•^mostly" successful . 

€ Three schools' administrative staffs judged the curriculum component 
to be "mostly" successful. One thought it was "somewhat" successful. 

• The tutor component was believed to be "completely" successful 
by two schools while one school said they had "no idea" about 
its success. This school had just had tutors for 2 1/2 months 
prior to the interview. The fourth school did not have tutors. 

Complete results are shown in Attachment E-2. 



Project Administrators' Interview 



Both the project coordinator and project specialist saw the three Title VII 
components as being successfully implemented. Specifically they believe: 

• Project teachers are adapting content areas appropriately for 
LEP students. 

• Very few students involved have dropped out. 

• Teacher competency in instruction of LEP students is increasing, 

• LEP student attendance is increasing. 

• Teachers have a more positive image of LEP students; to the extent 
this is conveyed to the students, a more positive self-concept may 
result. 

• Coordination is improving among and between teachers as a result 
of videotaping in endorsement classes- 

• Tutoring assistance is impacting LEP students' learning and 
knowledge of Engl ;h. 
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The project coordinator and project specialist made these recommendations for 
modifications or improvements: 

• The ESL endorsement program should continue, 

• The tutor program should be expanded, 

t Workshop training sessions should be continued with an advanced series 
of topics concerning instruction of LEP students (Listed in 
Attachment 

• Videotapes and the handbook bibliography should be consolidated for 
greater accessibility, 

• Title VII should be expanded to include other LEP groups. 

Complete results are shown in Attachment E-4. 

There is a general pattern of positive agreem'ant among the administrators, 
project coordinator, and project specialist concerning implementation of the 
three program components. Observations were particularly positive at those 
schools which had larger Hispanic LEP populations, more teachor participants 
in training activities, and/or had university tutoring assistance for two 
semesters. 
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(Page 1 of 5) 



Campus Administrator Interview Questions 

!• How well have project teach^^rs implemented Title VII program objectives 
with LEP students in terms of successes or problems in the following: 

Adapting the content areas to meet the needs and levels of the LEP 
students? 



Developing appropriate and varied strategies for evaluation of LEP 
students? 



Decreasing the dropout rate of LEP students? 
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Demonstrating increased competency in instruction of LEP students? 



Do you feel Title VII has impacted LEP student attendance? 

Yer^. No 

Coniiifents: 



In your opinion, has Title VII positively impacted the self-concept and 
school attitude of LEP students? 

Yes, A Lot To Some Extent Not At All 

1 2 3 



Comments: 
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Attachment E-1 
(Page 3 of 5) 



4. In your opinion, what impact has Title VII had upon the acquisition of 
English language skills and academic content achievement of LEP students? 



5. What coordination are you aware of that has occurred among ESL and 
content area teachers? 

Has it improved? Yes No 

Is it adequate? Yes No 

Comments: 



6. Did any problem(s) occur wh^'ch could impact Title VII program outcomes on 
your campus (teacher ratings, achievement of students)? 
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(Page 4 of 5; 



7. How successful do you believe each of the Title VII components were thi; 
year? 

Completely Mostly Somewhat Not At All 

12 3 4 

Staff Development 1 2 3 4 

Tutors 1 2 3 4 

Curriculum Development .1 2 3 4 

Comments: 



8. What recommendations do you have for modifications or improvement o^ the 
Title VII program in terms of: 

Staff Development? 



Tutors? 
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Attachment E-1 
(Page 5 of 5) 



Curriculum Development? 



9. Do you think that other campuses would benefit from having Title VII 
services available for LEP students? 
Yes No 

Why or why not? 



10. Overall, do you feel Title VII has had an impact? 



id 
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Attachment E-2 
(Page 1 of 6) 



Campus Administrator Interview Questions 

HoM well have project teachers implemented Title VII program objectives 
with LEP students in terms of successes or problems in the following: 

Adapting the content areas to meet the needs and levels of the LEP 
students? 

School #1 Some qreat changes! Students say that they are more 

ccnfortable and that the attitude toward them has changed* 
Teachers are using more appropriate texts, and lesson plans 
are more tailor-made. Teachers appear more comfortable 
asking for help. They perceive more support with more 
resources available. Also, they are more aole to adapt or 
make appropriate materials for LEP students. 

School #2 Title VlTs ESL training and endorsement program have 

impacted a low failure rate. This is credited to the Title 
VII funds that were used for computer software, student 
workbooks, and tests. 

School #3 There were no complaints of any kind from students or anyone 
else. No one has come to either the administrator 
or LEP coordinator with problems about LEP students. The ESL 
teacher has worked with students outside of school hours, and 
other teachers have come to her to consult about LEP students. 

School #4 They have adapted it well. Several ESL students have made 
the honor roll . 

Developing appropriate and varied strategies for evaluation of LEP 
students? 

School #1 Teachers have a better handle on it, because they are now 
more able to adapt materials. Expectations are more 
realist''*c. Tools used to evaluate are more catered to 
students. 

School #2 The Prueba Riverside test is a new evaluation tool and will 
be used to determine what's happening to Spanish skills. 

School #3 I don't feel comfortable in answering. The teachers would 
have to answer. 

School #4 They're in the process of doing it now. This is the goal 
monitoring stage. 
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Attachnicnt E-2 
(Page 2 of 6) 



Decreasing the dropout rate of LEP students? 

School #1 Absolutely. It*s increased the holding po\ir. 

School #2 Hard to say. Prevention is hard to measure. The tutors are 
helping and will help students (LEP) who are marginal. This 
program has only jeen in effect this year, since November. 
This is a gut-level reaction. 

School #3 Having outstanding people in the teaching role is the key here. 

School #4 It has improved since the beginning of the year. We have 
98-99% holding power for LEP' students. 

DeKonstratIng Increased competency In Instru^ Ion of LEP students? 

School #1 This is reflected in the attitude of students, teachers, and 
retention of students. 

School #2 ESL training has helped out a lot, especially the content area 
teachers. I think this is due to both training and workshops 
aiid the techniques to overcome fear. Teachers are requesting 
more LEP students. 

School #3 This is Difficult to answer. 

School #4 They work very closely with students. Teachers are still in 
the training process, and '^ot all LEP students are with 
trained teachers. However, lEP students receive instruction in 
the basic academic areas with trained teachers. 

2. Do you feel Title VII has 1p*pacted LEP student attendance? 

Yes/// No 

Conmenws: 

School #1 Yes, significantly. It has been a tremendous over the last 
couple of years. 

School #2 Yes, student aides have improved self-concepts. Title VII 
funds and training have helped a great deal with the LEP 
population, the majority of which are Hispanic. 

School #3 It h»;s had a great deal to do with their attendance. But, it 
may be due a great deal to the teachers, too. 

School #4 They have good attendance. They're enriched. L.e^ reel that 
:chool is home. They want to learn. 
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Attachment E-2 
(Page 3 of 6) 



3. In your opinion, has Title VII positively Impacted the se1f*concept and 
school attitude of LEP students? 

Yest A Lot To Soctc Extent Not At All 

1 ///r : 3 

CoMief's: 

School #1 Students find themselves fitting into a program and getting the 
skills they need. The Hispanic students' organization is 
active and Title VII project teachers are the majority of those 
helping the students plan the Cinco de Mayo celebration. 

School #2 Yes, a lot, through wonderful principal backing and teachers 
who have attended workshops. 

School #3 (No additional comment.) 

School #4 Absolutely. 

4. In your opinion, whst Inpact has Title VII nad upon the acquisition of 
English language skills and acadealc content achlevenent of LEP students? 

School #1 It has undoubtedly made a significant Impact upon students by 
helping teachers help students. 

School #2 We will be able to have a more objective report after ITBS 

testing. The ESL teacher breaks up his class into three groups 
with the Title VII tutor, another university tutor from a 
different education class, and himseli. Tutors are a great 
help. 

School #3 Considerable. This is because of the feedback the ESL teacher 

gets from the other five teachers who instruct LEP students- 
School #4 Students are now making the honor roll. Students have made 
documented gains in reading. 

5. What coordination are you aware of that has occurred among ESL and content 
area teachers? 

Has It Improved? Ye s /// No f_ 

Is It adequate? Yes /// No Ver ^c.-/- r-^^^J^/ /^of ^ 

Connents: 

School #1 Project Assist is also helping LEP students. Title VII 

teachers are sharing concerns and ideas with Project Assist 
teachers. 



164 



rn?/-- APPENDIX E 

EKJC 12 



86.25 

Attachment E-2 
(Page 4 of 6) 

School #2 It was good but now it's even better. Teachers get together to 
place students, paving the way for student transition, 
coordination of materials. Three times a week teachers stay 
over to give help to students. Coordination may not be 
adequate because of tine constraints. No time is allotted for 
coordination. It is just squeezed in at present. 

School #3 The ESL teacher works extremely well with teachers of LEP 
stMdj^nts. 

School #4 This has been a year of implementation. Our attendance rate 
and scholastic success has been noted by TBE The coordination 
is gcod but more is still needed. 

6. Did any problenCs) occur which could Impact Title \A program outcomes on 
your campus (teacher ratings, achievement of students)? 

School #1 No. 

School #2 Hard to say. May be better observed by the central 

administration. Seemed fine here on the receiving end. We 
want more teachers. Bilingual teachers have the most 
students. One class is at 36 students. 

School #3 The major problem was distribution of materials. When you 

called to request materials, they had more of what you had, not 
what you needed. 

School #4 At the beginning there was some resistance from the teachers. 

We did not have enough time to do adequate public relations. 

7. How success/ul do you believe each of the Title VII components were this 
yiar? 

Completely Mostly Somewhat Not At All 

12 3 4 

Staff Development 1 Z tH^ 3 4 

Tutors IV o SJe^ ^ 1 // 2 3 M>J.Kl. 

Curriculum Development 1 1 uf 3/ 4 

Comments: 

School #1 Tutors are great. Teachers are still saying more, more for 
curriculum development. 

School #2 (No additional comment). 

School #3 Only six to eight teachers are involved in staff development, 
although th^»y have discussed this with other teachers. 

School #4 It's hard to say, because weVe in the early stages of 
implementation. 
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8. What reconnendatlons do have for modifications or Improvement of the 
Title VII progran In terns of: 

Staff Development? 

School #1 It depends on who moderates it. Teachers need refresher 

courses, a boost from time to time. "Where am I now? Where do 
I need to go?" The most critical area is reading comprehension. 

School #2 Involve all my staff. It should not be voluntary (workshops). 
We are a special sciiool. The students should be sent home 
early so that the teachers are not giving more extra time. 
Workshops should be held three times a year. They should focus 
on sensitivity and removing fears. Usually the child is so 
ready to learn. The entire staff should be involved so 
everyone Is able to take kids. 

School #3 I don't have any. 

School #4 We need more teacher training. Now we have our core people. 
Tutors? 

School #1 Send more. They're doing very well. They*re learning as much 
as the students. 

School #2 More! More contact hours. What we have has been great. 

Everybody should have them. When the art teacher has two 
tutors all goes well. If she had them every day- 
School #3 (No additional comment.) 
School #4 (Not applicable.) 
Curriculum Development? 
School #1 I don't feel qualified to answer. 

School #2 The LEP coordinator and his department were to be paid a flat 
rate for two weeks in the summer by the district. This does 
not reflect the many hours of research and planning the project 
would have necessitated. People burn out when they ara not 
paid a comparable wage for their time and effort and you lose a 
valuable r^sour^^'^. 

School #3 (No additional comment.) 

School #4 (No additional comment.) 
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9. Do >CHj think that other casipuses would benefit frosi having Title VII 
services available for LEP students? 
YesirV No V(^s, ^u^l.^^ 

Why or why not? 

School #1 They would benefit if they had the situation we have. Without 
the numbers, it tends to isolate the student. Without enough 
students, it wowld probably experience less surcess. 

School #2 I would think so but Wouldn't want to give up our program. 
Maybe for Vietnamese , other LEP's. Our overall 

enrollment is decreasing but the LEP student population will 
stay the same or increase. It has been increasing 20 percent 
per year. 

School #3 I would presume so. 

School #4 Absolutely. Right now we have a waiting list of students. 



10. Overall, do you feel Title VII has had an impact? 

School #1 Absolutely. Very positively. The project specialist has done 
a tremendous job. 

School #2 We're definitely better off than before the Title VII program. 

Our school is more cost effective for impacting LEP students. 

School #3 Yes, with our students. 

School #4 Definitely. 
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Coordinator/Specialist Interview Questions 

1. Was Title VII implemented as j.'anped? 

Completely Mostly To Some Extent Not At All 

12 3 4 



What deviations, discrepancies, and/or modifications have occurred? 



Did any problems occur which affected just one or some of the campuses 
and which could impact program outcomes (teacher ratings, achievement of 
students)? 



2. What expectations did you have for project effectiveness in tarns of 
attendance at inservice, participation in endorsement classes, training 
outcomes, use of techniques? 



Were your expectations met? 

Yes No 

Comments: 



3. How well have project teachers implemented Title VII program objectives 
with LEP students in terms of successes or problems in the following: 

Adapting the content areas to meet the needs and levels of the LEP 
students? 
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Developing appropriate and varied strategies for evaluation of LEP 
students? 



Decreasing the dropout rate of LEP students? 



Demonstrating increasing competency in instruction of LEP students? 



4. Do you feel Title VII has impacted LEP student attendance? 

Yes No 

Comments: 



5. In your opinion, has Title VII positively impacted the self-concept and 
school attitude of LEP students? 

YefM A Lot To Some Extent Not At All 

1 2 3 

Comments: 



6. What coordination has occurred among ESL and content area teachers? 

Has it improved? Yes No 

Is it adequate? Yes No 
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Comments: 



1. Did Title VII enhance the TBE services for the participating (A & B) 
Hispanic LEP students? 

Yes No 

Comments: 



8. In your opinion, what impact has Title VII had upon the acquisition of 
English language skills and academic content achievement of LEP students? 



9* How successful do you believe each of the Title VII components were this 
year? 



Completely Mostly Somewhat Not At All 

12 2 4 

Staff Development 12 3 4 

"tutors 12 3 4 

Curriculum Development 12 3 4 



Comments: 



iO. What recommendations do you have for modifications or improvement of the 
Title VII program in terms of: 

Staff Development? 
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Tutors? 



Curriculum Development? 



11. Do you think *hat other campuses would benefit from having Title VII 
services available for LEP students? 
Yes___ No 

Why or why not? 



12. How do you think the project has been received at the other four ^.ampuses? 
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Coordinator/Specialist Interview Questions 

1. Was Title VII Implemented as planned? 

Completely Mos|Jy To Some Extent Not At All 

1 (T> 3 4 



What deviations, discrepancies, and/or modifications have occurred? 

Major program changes did not occur. One of the major changes was that 
the project specialist was not hired until September 1, the evaluator 
associate until September 24, and the secretary until October or 
November, 1985. Also, the original proposal did not specify how the 
tutor component was to be carried out. There were really no deviations 
or discrecunuies except for the timeline which was due to the grant 
coming in 6 months later than expected. Projected modifications in the 
designated project schools were sent to Washiigton for approval. 

Did any problems occur which affected just one or some of the campuses 
and which could impact program outcomes (teacher ratings, achievement of 
students)? 

There were none. 

2. Uhat expectations did you have for project effectiveness in terms of 
attendance at insGrv1ce» participation in endorsement classeSs truining 
outcomest use of techniques? 

The grant specified paid tuition would be provided for 15 teachers. This 
was met. We had a very good cross section of staff attending workshop 
sessions. The videotapes (used in the endorsement classes] give good 
evidence of teaching techniques. The sensitivity and knowledge is there. 
Over 90 percent are applying techniques and experiencing success. 

Here your expectations met? 

Yes // No 
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3. How well have project teachers implemented Title VII program objectives 
with LEP students In terns of successes or problems In the following: 

Adapting the content areas to meet the needs and levels of the LEP 
students? 

They've adapted them well. 

Developing appropriate and varied strategies for evaluation of LHP 
students? 

This is not a current objective of the program, but it is a number one 
priority for next year. We want to do an on-site inservice in this 
area. We're already working with individual teachers now, modeling 
student evaluation for them. There is a tremendous need for this type of 
assessment in schools. 

Decreasing the dropout rate of LEP students? 

I've talked with members of each school and noted what happened to 
students who were not there for posttesting. Most had moved. There are 
very, very few dropouts. At Travis and Johnston thert are no dropouts. 
At Anderson there was one dropout and at Murchison there were 11 dropouts. 

Demonstrating Increasing competency In Instruction of LEP students? 

Great! 

4. Do you feel Title VII has Impacted LEP student attendance? 
Yes|/ No 
Comments: 

At Travis the attendance is excellent. I've had minimal make-ups at 
Travis (posttesting) because students have been there. Attendance has 
improved over the year at Murchison. I noticed this when I went back to 
do the posttests. Compared to the beginning of the year, when I had to 
go back again and again, I only had to go back twice. They still are 
having problems with the buses and that's probably the number one problem 
impacting attendance at Murchison. But, the problem is less now than it 
was at the beginning of the year. Anderson and Johnston have had good 
attendance, but I don't know whether this has been due co Title VII or 
not. There are so few LEP students at Johnston and Anderson. They don't 
volunteer to go into an environment which is not in their language unless 
they want to be there. 
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5. In your opinion, has Title VII positively Impacted the se1f*concept and 
school attitude of LEP students? 

YeSftJ\ Lot To Some Extent Not At All 



Comments: 

It has positively impacted the teachers' image of a LEP student and 
that in turn has to have impacted the student, 

6. What coordination has occurred among ESL and content area teachers? 

Has It Improved? YesJ^ Ho 

Is It adequate? YesJ/^ No 

Comments: 

It is adequate but it could always be improved. Videotaping developed a 
lot of fellowship because teachers had to meet togetht.\ This is tied to 
the endorsement class and coming together to meet for three hours each 
week. Another example of this is the supplemental materials purchased by 
Title VII that are available for check out at all the schools. 



7. Did Title VII enhance the TBE services for the participating (A & B) 
Hispanic LEP students? 

Yes // No 

Comments: 

Definitely. 

8. In ; jr opinion, what Impact has Title VII had upon the acquisition of 
English language skills and academic content achievement of LEP students? 

The students • scores (posttest) will show it. Tutors have ha^ a big 
impact. They have clarified assignments and have helped with homework. 

9. How successful do you believe each of the Title VII components were this 
year? 



Completely No^^tly Somewhat Not At All 

12 3 4 

Staff Development (V Z Z 4 

Tutors ^ 2 3 4 

Curriculum Development 1 (7 J 3 4 



Comments: 



The curriculum development is by no means complete but has an excellent 
start. The videotapes will be invaluable. We're happy with what has 
been done but there is more to be accomplished. 
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10. What recoimendatlors do you have for modifications or improvement of the 
Title VII progran in terms of: 

Staff Development? 

The endorsement program should be continued. There should be an advanced 
workshop series to Include evaluation of students, planning and 
organization of instruction, demonstration of teaching strategies through 
videotaping, and computer assisted instruction and evaluation of computer 
software. 

Tutors? 

More! St. Edward's University will participate next year. It is not as 
effective to have the university tutors put in large blocks of time in 
the beginning. It is better to assign one tutor to one teacher for one 
period for a full semester. 

Curriculum Development? 

We need to pull it together into a usable form in the second year. 

11. Do you think that other campuses would benefit from having Title VII 
services available for LEP students? 

Yes // Ho 

Why or why not? 

Other LEP language groups (non-Hispanic) would benefit. Almost all A&B 
Hispanic LEP students are now being served. 

12. How do you think the project has been received at the four campuses? 

It has been received extremely well by principals, content area teachers, 
ESL teachers, university staffs, and the parent community. 
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TEACHER. SURVEY 



Purpose 

Questions were included in the districtwide survey for teachers and 
administrators of Title VII program student participants. Responses provided 
information concerning the following questions: 

Decision juestion Dl ; Should the Titl VII Program be continu^^d as it 
Is, modified, or discontinued? 

Evaluation ^estlon What concerns/strengths about the 

implemenlation of the project were identified by project teachers? 

Evaluation Question Dl-9 . Was the program implemented as planned? 

Informitio n Weed 12 . Did the project meet its objectives? 



Procedure 

Surveys 

One half of the AISD^s teachers are surveyed in the fall and one half in the 
spring witii questions on a wide variety of topics. Teacher Survey questions 
wera generated by the Office of Research and Evaluation (ORE) staff with input 
from the program director and procja.^i specialist. These questions were 
designed to elicit information aoou^. the implementation and effectiveness of 
the three program components: staft training, tutorial services, and 
curriculum development. The Teacher Survey questions were then passed on to 
the evaluation associate for Management Information who sends out surveys 
ann»«^lly to about one half of all teachers and administrators in Austin 
Independent School District (AISD). (S>:: Attachment F-1 .''or details.) 

The Teacher Survey was sent to project participant teachers in the 
Districtwide Survey on April 28, 1986. This year the surveys went out later 
than other years. The surveys were attached to a memo that explained why the 
surveys were late (see Attachment F-2 ). ^ 

It shoiild be noted that the item response rate for endorsement teachers and 
teachers with' tutors was lower than the repokted genera^ response rate of all 
teachers and administers surveyed. Whereas the overall response rate was as 
high as 98% (See Attachment F-1), item responses of the endorsement teachers 
ranged between 32% and 52%; out of 23 asked 9-12 res^^nded. Of the surveyed 
teachers with tutors, item responses were received from 45%; 9 out of ZQ 
responded. Subsequently, sample sizes were small and usually represent 40% to 
50% of those surveyed. It is not clear why the response rate was not higher. 
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A low response rate was also noted for open-ended questions sent to endorsement I 

teachers which addressed training effectiveness (See Figure F-3). As can be I 

seen, less than one-third of those surveyed responded (7 out of 23 teachers). I 

Whether these respondents were representative of the total se;,.iple of endorse- I 

ment teachers and/or only those who had stronger motivation to comply with the I 

survey request is questionable. This makes interpretation difficult; I 

subsequently, the responses are left unsummarized. I 

Also, the Likert-type response scale used in the tutor survey items was I 

altered by the district management evaluation asSJciate or program analyst. I 

This caused a problem in the case of three items (Figure F-1; Items 118, 119, I 

& 120) where the original five point scale, ranging from "strongly agree to I 

strongly disagree," was changed to a four point scale, ranging from "greatly I 

to none" (greatly, some, little, none). It was unclear whether an answer of I 

"some" was a positive or neutral resoonse. Also, there seemed to be a big I 

jump between the choict of "greatly" and "some". I 

Items concerning program objectives (items 134-136) were sent to endorsement I 

teachers only» If teachers with tutors had been asked about the effectiveness I 

of program objectives, ratings might have been higher. Teachers with tutors I 

generally indicated that the tutc: component contributed to student gains in I 

academic and English language skills. I 

r 

Sample I 



Items given to the two groups varied. 
GROUP 

Teachers with Tutors (Figure F-i) 
Endorsement Teachers(Figure F-2)* 



ITEM NUMBERS 
113-120 
121-138 



Two teachers were participants of both groups and received all questions. 



^Endorsement teachers* responses to open-ended questions are shown 
in Figure F-3. 



Results 

Evaluation Question Dl-8 : What concerns/strenyths about the 
Implementation of the project were identified by project teachers? 

Project endorsement teachers were surveyed; opinions from this group 
were mixed about training effectiveness. 
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§ Half of the endorsement indicated that their training was almost always 
or frequently interesting and informative; 50% said this was sometimes 
or rarely true. (Figure F-2; Item 122,N=10) 

t Of those responding, 40% (N=4) of the teichers asked indicated that 
their trainers were almost always or frequently knowledgeable and well 
prepared. However, 60% (N=6) of the total said that this was sometimes 
true. (Figure F-2; Item 121, N=10) 

t Half of the teachers asked indicated that their training almost always 
or frequently reinforced old skills; 50% responded that this was 
sometimes the case. (Figure F-2; Item 125, N=10) 

t Of the teachers responding, as many indicated (N=3) that their training 
almost alWiTys or frequently presented new skills as responded (N=3) 
that it rarely or almost never did (30% each). The remaining 40% (N=4) 
responded that this was sometimes tht case. (Figure F-2; Item 124, 
N=10) 

t More than one-fourth (27.3%, N=4)) indicated that Title VII training 
information was almost always or frequently useful in the classroom; 
7?. 7% (N=8) said that this was sometimes true. (Figure F-2; Item 126, 
N^l) 

t A majority of the teachers (63.6%, N=7) responded that the students 
sometimes benefitted because they had received Title VII training. Of 
the remaining 4 respondents, as many said (18.2%) this was frequently 
the case as indicated (18.2%) this was rarely or almost never true. 
(Figure F-2; Item 128, N=ll) 

t One-third of the teachers (33.^5%, N=4) indicated that the program was 
implemented as planned; 58.3% (N=7) said that this was sometimes true 
and 8.3% (N=l) responded that this was rarely the case. (Figure F-2; 
Item 134, N=12) 

t The percentage of teachers who indicated they used these techniques 
almost always or frequently was: 

— Whole class - 63.1% (N=ll), 

— Large group (more than 7; - 54.6% (N=ll), 

— Small group (Less than 7) - 27.3% (N=ll), 

— Individual instruction - 30 S% (N=13), 

— Student pairs - 15.45J (N=13). (Figure F-2, Items 129-133) 



Thus, whole group and large group instruction v/ere the most common. 
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Evaluation Question Was the program implemented as planned? 

Information Need 12 . D . the project meet its objectives? 

Objectives were related to the effectiveness of the Title VII program in 
Improving the English language proficiency and academic skills of program LEP 
students. One of the program components, tutor implementation was designed lo 
assist program LEP students in maeting these goals. Questions concerning tutor 
effectiveness were specific; other questions on the survey were more general, 
dealing with the implementation of the program. All responses reflect teacher 
opinion. This information may be helpful in understanding the result*^. 

Teachers who had tutors for at least part of one school semester were surveyed. 
They were generally positive about the use of tutors. On the following item 
responses N*9. 

• Two-thirds of the responding teachers (66.6%, N=6) indicated that as 
a result of working with Title VII tutors, students had greatly or 
somewhat improved their English skills. However, 22.2% (N=2) of the 
teachers said there was little improvement; 11. li 'N=l) indicated that 
they saw none. (Figure F-1, Item 113) 

9 Most of the teachers (88.8%, N=8) indicated that their students had 
improved in academic skills as a result of working with tutors; 11% 
(N=l) said that they saw little improvement. (Figure F-1, Item 119) 

• Most of the teachers (77.7%, N=7) ) indicated t\ X their students' 
attitudes toward learning had greatly or somewhat improved as a result 
of working with tutors; 22.2% (N=2) said they saw little improvement. 
(Figure F-1; Item, 120, N=9) 

• Most of the responding teachers indicated that their tutors were almost 
always or usually: 

— knowledgeable (66.6%; N=6),) 

—well prepared (66.6%; N=6),) 

— reliable (77.7%; N=7),) 

—positive in their interactions (88.9%; N=8). (Figure F-1, Items 
114-117) 

The remaining teachers indicated that these statements were sometimes true. 
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Project endorsement teachers were also surveyed about more general program 
objectives. 

§ Three-quarters of the teachers responding (N=9), indicated that Title 
VII had been effective almost always or frequently in helping LEP 
students acquire English language skills; 25% (N=^3) said this was 
sometimes true. (Figure F-2; Item 136, N=12) 

• Over three-quarters of the teachers (77,7%, N=7) responded that the 
program was almost always or frequently effective in promoting the 
academic achievement of Hispanic LEP students. All other teachers 
indicated (22.2%, N«2)) that this was sometimes true. (Figure F-2; Item 



• Half of those responding indicated that Title VII almc<;t always or 
frequently facilitated better coordination among ESL and content area 
teachers for assisting LEP student learning; 50% said that "his was 
sometimes the case. (Figure F-2; Item 138, N=12) 

t Over two-thirds of the teachers indicated (72.8%, N=8) that other 
secondary campuses could almost always or frequently benefit from 
having Title VII available for LEP students; 28.2% (N=3) said that this 
would sometimes be true. (Figure F-2; Item 135, N=ll) 

The findings can be summarized by the following: 

t Teachers who had tutors were generally very positive about their impact. 

• Endorsement teachers were unsure about the effectiveness of the training 
component* The majority said their students had sometimes benefitted 
because of their teacher training. Slightly more than one-fourth 
indicated that training information was useful in the classroom. 

t At least three-quc ters of the endorsement teachers indicated that LEP 
students* academic and English language skills had been positively 
impacted by Title VII Program objectives. 
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li3,rirLE VII TUTURS AKE HELPTUL TU MY STUDHNTS. 

A.ALKAVS a. USUALLY C. SOMETIMES 0. SELDOM E. NEVER 
NUMBER OF 





RESPONSES 


A 


B 


C 


U 


E 


TOTALS 


13/20 


5 
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4 

30.84; 


1 

7.7? 


0 

0.0% 


3 

23.1? 


JR HI(iH 


4 


2 

50.0* 


1 

25. 0« 


1 

25. 0« 


0 

, 0.0% 


0 

0.0? 


HIGH SCH 


9 


3 
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3 

33. 3i 


0 

0.0? 


0 
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3 

33.3? 


SECUNUARY 
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5 

3b.54i 


4 

30.8% 


1 

7.7JC 


0 

0.0% 


3 

23.1? 



114. TITLE VII TUTORS ARE KNOWLEUoEAULE. 

A.AL>«AYS B. USUALLY C.SUMEUMES O.SLLUUM E. NEVER 
NUMBER UF 





RESPONSES 
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B 




C 


0 


E 
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9^ 
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3 
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3? 
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Figure F-1. RESP0N5.ES OF TEACHERS WITH TUTORS, 198 , ITEMS ON TITLE VII 
PROGRAMS. (Page 1 of 4) 
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li;>.rirLfc VIl lUrUKS AKfc WtLL PktPARED. 

A.ALwA/b U. USUALLY CiOMETlMtS U. SELDOM E.NEVtK 
NUMBER (JP 
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). 
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ll6.nrLE VII TUIORS ARE RELIABLE. 

A. ALWAYS B. USUALLY C.SCJMEIIMES U. SELUOM E. NEVER 
NUHBER OF 
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B 
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E 


TOTALS 
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2 


2 

iOu.o:s 


0 

0.0* 


0 


0 

.oz 


0 


0 

0.0% 


HioH SCH 


7 


2 

28. 6/" 


3 

42.9:^ 


28 


2 

.6^ 


0 

0.0^ 


0 

0.0% 


SECuNOARY 


9 


4 

44.4$ 


3 

33.3? 


22 


2 


0 

0.02 


0 

0.0% 



Figure F-1. (Page 2 of 4) 
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117. TITLE Vli TUIURS HAVE PUSITlVt AITITUUtS. 

A. ALWAYS b. USUALLY CSOMbTIMHS U.SHLUUM E.NtVtU 
NUMBER UF 





RESPONSES 


A 


B 


c 


0 


E 


TUTALS 




5 

55.6^ 


3 

33.3? 


L 

11. Li 


0 

0.C4 


0 

0.0? 


JR HIGH 


2 


L 

50. Oi 


L 


0 

0.0^ 


0 

O.Oii 


0 

O.Oi 


HIliH SCH 


7 


51.1% 


2 

?.a.6i 


1 


0 

U.04; 


0 

0.0« 


SECONUARV 


9 


5 

55. 6i 


3 

33. 3i 


1 


u 


0 

u.o? 



lia.Ai A RhbULT OF WORKING WITH TITLE VII TUTORS, MY 
STUDENTS HAVE IMPROVED I HEIR ENGLISH SKILLS. 
A.GREAlLY B.SuME C. LITTLE D.NUNE 
NUMBER OF 

K&SPONSES A B C 0 

TOTALS 9/90 i J ^ I 

33.3-4 33.3>> ZZ.Z4 LI. Li 

JR HIGH 2 0 2 0 0 

0.0$ LUO.O.g O.OS 0.0£ 

HIGH SCH 7 3 L 2 I 

A2.9? L4.3'i 28. Oi l^.Si 



SECUNUARY 



33. 3^ 33.3.4 22.2-6 1.L.I? 



Figure F-1. (Page 3 of 4) 
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il9.AS A RkbULT OF WUKKiNG WITH TITLE VII TUFDRSj MY 
SlUUENTS HAVt IHPRUVED IN ACAOEMIL SKILLS. 
A.GREATLy B.SLlME C. LITTLE U.NCNE 
NUMBER UF 





D C CD flM C C C 

K Cor UlMoc 5 


A 




o 




C 


U 


rOTALS 


i 


4 




4 




1 


0 




44. 4$ 


44 


.44i 


11. 


1? 


0.0? 


JR HIGH 


2 


1 




I 




0 . 


0 








50 


.04 


0. 


{)% 


0.0* 


HIGH SCH 


7 


3 




3 




i 


0 






42.9? 


42 


,9* 


14. 


3^ 


0.0-£ 


SECONDARY 


9 


4 




4 




I 


u 






44.4:? 


44 


.4^' 


11. 


IK, 


0.0^ 



120. AS A RESULT OF WORKING WIIH TITLE VII TUTORS, MY 
srUDENIS HAVE iMPROVEO AITITUOES TOWARD LEARNING. 
A.uREAILY B.SOME C. LITTLE U.NONC 
NUMBER OF 





RESPONSES 


A 


B 


c 


0 


TOTALS 




3 

33.3^ 


4 

44.4? 


2 

22.2? 


0 

0.0? 


JR HIGH 


2 


0 

0.0? 


2 

100.0? 


U 

0.04 


0 

0. 04 


HIGH SCH 


7 


3 

42.9? 


2 

28.6? 


2 

28.6? 


0 

0.0? 


SECONDARY 


9 


3 

33. 3i 


4 

44.4^ 


2 

22.2? 


0 

0.0? 
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12l.TiTLt VI i tNUUKStMtWr ANl) I.MbliKVlCt TRAINERS KCkE 
KNUWLfcOCiEABLE ANU WhLL PREPARED. 
A.ALMuil ALWAYS C. SUML TiHhS E.ALMUSF NfcVER 
a.FREUULNrLY U. RARELY 

NUMBER OF 





RESPONSES 


A 


B 


C 


U 


t 


TUIALS 




I 

20. 


2 

2 0.0^ 


6 

60.0.S 


0 

0.04i 


0 

U.0{ 


JR HIGH 


1 


0 

U.0% 


0 

0.0.1; 


I 

lOJ.o:^ 


0 

0.0-^ 


0 

0.o:g 


HiGh SCH 


9 


2 

22.2% 


2 

22.2^ 


5 

55. 6« 


0 

0.0^ 


0 

o.os 


SecUNUARV 


10 


2 

20. 


2 

2G.O^ 


6 

60. 0« 


U 

o.o:g 


u 

0.0{ 



122. TITLE VII ENUURSEHENl ANU INSERVICE TRAININO wAS 
INTERESTING ANU INFuRMAIIVt. 

A. AL.MOSJ ALWAYS C. SOMETIMES E. ALMOST NEVFR 

B. FREQUENTLY U. RARELY 

NUMCER OF 

RESPUNSES A B C 0 E 

TOTALS 10 /2-? 1^410 

10. Oi 40. 0« 40.0'^ 10. 0* 0.0-S 

JR HIGH I 0 0 1 0 0 

0.0« O.Oi" 100. 0;S 0.u« Q.O* 

HIGH SCH 9 14 3 10 

11. i« 44.4^ 11. K 0.0? 

StLUNLiARY 10 1 4 I Q 

10. 0? 40.o.i 40. o« 10. o:^ 0.0?; 



Figure F-2. iVtSPONSES OF ENDORSEMENT TEACHERS, 1986 ITEMS ON TITLE VII 
PROGRAM. (Page 1 of 9) 
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l^J.TH": LUi\.4loTIU«M OLTWEEN IHEURY ANU APPLICAriUN FUR 
riTLh Vil TRAINING k^AS CLtAKLY STATED. 
A.ALMU5T ALWAYS U.SUMhllMES E. ALMOST NEVER 
D.FREwUtWTLY U.RARfcLY 
NUMBER OF 





RESPONSES 




A 


B 


c 




u 


E 


TUT ALS 




10 


1 


2 

20.0^ 


6 

60.02 


10 


1 


0 

0.0« 


JR HIGH 


i 




0 


0 


I 




0 


0 






0 


.04 


0.0« 


100. 0^ 


0 


. 0:1 


o.o>«; 


HIGH SCH 


9 




1 


2 


5 




1 


0 






11 


,1% 


22.2* 




11 




o.o« 


SECONDARY 


iO 




I 


z 






I 


0 






10 




20.0* 


60.0.6 


10 


.0^ 


o.o-s 



124. TITLE VII ENUURSEMENT ANU INSERVICL TRAINING 
FKESENIEO NEW SKILLS. 

A.ALMUSI ALWAYS CSuMhTIMEa E.ALMuST NEVER 

U. RARELY 



B.FRtUUENILY 

NUMBER OF 
RESPONSES 



TOTALS 
JR HIGH 
HiGii SCH 



10' 



1 

10.0:^ 
1 

100. 0'^ 

0 

o.o:s 



2 

20.0^ 

0 

0.0^ 

2 

11.2% 



4 2 

40. o-*; 20.0^ 



u 

0.0^ 
4 

44.4^ 



U 

O.U b 

2 

22. 2« 



1 

10.02 
0 

O.Oi 

1 

11. u 



SECONDARY 



10 



2 



10.02 20.0% tO.J2 



2 

20.0^ 



I 

10.02 



Figure F 2. (Page 2 of 9) 
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125.riILL Vil ENDUKbCMENl AND INSCRVICE TRAINING 
REilJFUKChU ULU SKILLS. 

A.ALMUSl ALWA/S C.SOMtTIMES fc.ALMUST NtVER 

lJ. RARELY 



b.FKhwUCiULY 

NUMBER OF 
RESPUNSES 



TOTALS 
JR HIGH 
HIGH SCH 
SbCUNUARY 



L 
9 
10 



B 



30.0* 20. 0« 50.0? 



I 

iOO.O* 



0 

u.o^ 



0 

0,0i 



Z2.2Z 22. 2^ 55.64 



30, Oi 20. 50.01 



0 

O.Oi 

0 

0.04 

0 

0 .04 

0 

0. o; 



0 

u.o^ 

0 

o.oz 

0 

o.oz 

0 

o.oi 



120.1 COJLJ APPLY IHE INFJRMATiUN PRCVIOED BY TITLE VII 
iNSbKVIUE IN IHE CLASSKUUM. 

A. ALMOST ALWAYS C.SuMfcTlMES b. ALMOST NEVER 

0. RARELY 



B.FREQJhWTLY 

NUMBER OF 
RESPONSES 



TOl ALS 
JR HIGH 
HIGH SCH 
SECUNOARy 



^ 



11 



2 

L6.2i 
1 

50.04 
1 

II. II 

2 

18.24 



B 
1 

9.1^ 
1 

50.04 
0 

0.04 
I 

9. U 



8 

72.7^ 

0 

O.Oi 

8 

88.94 
8 

72. 7i 



0 

0 

0.0^ 

0 

0.0^ 

0 

0.04 

0 

0.04 



0 

0.04 

0 

0.04 

0 

0.04 
0 

0.04 
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i;j/.THE fbtHiUJUtS Oh riTLE Vil INSblWlCH rtOKKtU WiiH 
GOUU REoUtrS. 

A. ALMUSr ALWAYS C.iUMtllMCS E.ALMUSF NEVER 

B. FKEuUENrty U. RARELY 

NUHBEK IIF 

r.ESPONSES A B C 0 E 

TUTALS ^^/S3 0 2 9 0 0 

' u.o^ 18. 2^ ai.a, 0.0^ o,oi 

JR HIGH ^ 0 i 1 U 0 

0.0% i)U.O^ 50. 0.0-g 0.0% 

HIGH SCH 9 0 18 0 0 

O.OJ 11. IS 88.y-g 0.0^ 0.0? 

SfcCuNUAKY 11 0 2 9 0 0 

0.0:1 18.2-^ 81.8^ 0.0« 0.0:S 



128. THE STUULNfS QENEFIflEU UbCAUSb i HAU RbCElVEU 
TITLE Vli fKAlNlNG. 

A. ALMUST ALWAYS C. SOMETIMES E.ALMDSf NEVER 

B. FRbQUEiMTLY U. RARELY 

NUMBER OF 

RESPONSES A B C 0 E 

TOTALS li/33 0 2 7 1 1 

' O.OZ Ld.2'4 bi.b% y.lX 9.1% 

JR HiGH 2 0 110 0 

G.Oi 50. Oi 50. OZ 0.0^ O.OZ 

HIGH SCH 9 0 16 11 

0.0-S 11. 1* 06. 7* ii.U 11. IX 

SECONDARY 11 0 2 7 11 

O.O-i; 18.2* 03.6* 9.U 9.1% 
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129. HUW OFTEN DO YOU USE WHOLE CLASS INSTRUCTION WHEN 
INSTRULliNO LEP STUDENTS? 



A. ALMOSI ALWAYS 

B. FKEUUENTLY 

NUMBER OF 
RESPONSES 



TOTALS 
JM HIGH 
HIGH SCH 
SECONOARY 



II 

2 



11 



C.SOMt TIMES 
U. RARELY 



E. ALMOST NEVER 



3 

27. 3« 
0 

0.0% 
3 

33.3% 
3 

27.32 



B 



36. 4i 
1 

50. 0% 
3 

33»3:i: 

36.4% 



3 

2/.3« 
1 

50.02 
2 

22. 2i 
3 

27.3* 



1 

9. 1% 
0 

o.oa* 
1 

II. IS 
1 

9.1« 



0 

C.02 

0 

0 

0.02 

0 

0.0« 



130. HOW OFTEN 00 YOU USE LARGE GROUPS 18 OR MORE) WHEN 
INSTRUCTING LEP STUDENTS? 

A. ALMOST ALWAYS C. SOMETIMES E. ALMOST NEVER 

0. RARELY 



B. FREQUENTLY 

NUMBER OF 
RESPONSES 



TOTALS 
JK HIGH 
HIGH SCH 
SECONDARY 



II 
2 



II 



A B 

2 4 

18.22 36.42 

0 2 
U.02 100.02 

2 2 

22.22 22.22 



2 

18.22 



4 

36.42 



3 

27.32 

0 

0.02 

3 

33.32 
3 

27.32 



I 

9. 12 

0 

0.02 
1 

II. 12 
I 

9.12 



I 

9.12 

0 

r.02 
1 

II. 12 
1 

9.12 
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131. HOW OFTEN OU YOU USE SMALL GROUPS C7 OR LESS) WHEN 
INSTRUCTING LEP STUDENTS? 

A. ALMOST ALWAYS C. SOMETIMES E. ALMOST NEVER 

B. FREQUENTLY 0. RARELY 



NUMBER OF 





RESPONSES 


A 


B 


C 


0 


E 


TOTALS 


11 


0 


3 


6 


2 


0 






0,0% 


27.3? 


54.5? 


18.2? 


0.0? 


JR HIGH 


2 


0 


1 


1 


0 


0 






o.ox 


50.0? 


50.0? 


0.0? 


0.0? 


HIGH SC'-I 


9 


0 


2 


5 


2 


0 






0.04 


22.2? 


55.6? 


22.2? 


CO? 


SECO^DARY 


11 


0 


3 


6 


2 


0 






0.0% 


27.3? 


54.5? 


18.2? 


0.0? 


132. HOW OFTEN 00 YOU 


USE PAIRS 


WHEN 


INSTRUCTING LEP 




STUDENTS? 












A. ALMOST ALWAYS 


C. SOMETIMES 


E. ALMOST 


NEVER 




6. FREQUENTLY 


0. RARELY 












NUMBER OF 














RESPONSES 


A 


B 


C 


0 


E 


TOTALS 


13 


1 


1 


7 


3 


1 






7.7« 


7.7? 


53.8? 


23.1? 


7.7? 


JR HIGH 


3 


0 


0 


3 


0 


0 






O.OX 


0.0? 


100.0? 


0.0? 


0.0? 


H'GH SCH 


10 


1 


1 


4 


3 


1 






10.0? 


10.0? 


40.0:: 


30.0? 


10.0? 


SECONDARY 


13 


1 


1 


7 




1 






7.7? 


7.7? 


53.8? 


23. 1? 


7.7? 
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13...HUW uHFtN DO YJU USE iNUlVlUUAL INSrRUC^^^JN WTH 
LfcP SlUUtNTS? 

C. SUMETIMES E.ALMUST NEVEA 

D. RARELV 



A. ALMOST ALWAYS 

B. FRtgUFNTLY 

NUMBER OF 
RESPUNSES 



TOTALS 
s'R HIGH 
HIGH SCH 
SECONDARY 



13 
3 
10 
13 



ABC 

0 4 7 

0 12 

0.0* 3J,3:« 66. 7* 

0 3 5 

Q»V% 30. OZ 50. OZ 

0 4 7 

0.0* 30. 8-^ 53.8^ 



0.0? 15.4? 

0 0 

0.0? o.ot 

0 2 

0.04: 20.0? 

0 2 

0.0? 15.4? 



mI'JamPUs! ^^'^^^^'^ IMPLEMENTED AS PLANNED 

C. SOME TIMES E. ALMOST NEVER 

D. RARELY 



A. ALMOST ALWAYS 

0. FREQUENTLY 

NUMBER OF 
RESPONSES 



TOTALS 
JR HIGH 
HIGH SCH 
SECONDARY 



12 
3 
9 

12 



2 

16. 7? 
1 



B 

2 

16. 7? 
1 



1 

11.1? 



1 

11. U 



2 2 
16.7? 16./* 



0 



1 



58.3? 8.3? 



33.3? 33.3? 33. 3i 0.0? 



6 I 
66.;? II. U 

7 I 
53.3? 8.3? 



0 

0.0? 

0 

0.0? 
0 

0.0? 
0 

0.0? 



Figure F-2. (page 7 of 9) 
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135.urHEK bLCUNDAKY CAMPUSES CUULU D ENCf 1 T FKUMHAV ING 
TITLE Vli SERVICES AVAtlAtiLt FuR L.P oFUUtNTS. 

A. ALMu!t ALWAYS CSUMEFIMES E.AL.MGSr NtVER 

B. FREwUtNILY 0. RARELY 

NUMBER OF „ r n E 

RESPONSES ABC" 

'^'^^^ 36.^1 36.4^ Z7.A O.ol O.ol 

^ 50. 50. U« O.OS 0.0? 0.0? 

^ 33.3* 33.3! 33. 3I O.OZ 0.0? 

SECUNO^RY U ^^^^^ ^^^3^ 



136 IIILE VII HAS BEEN EFFECTIVE IN HELPING HISPANIC 
UP STui NTS ACQUIRE ENGLISH LANGUAGE SKILLS. 

A. ALM3SI ALWAYS C. SOMETIMES t.ALMUST NEVEk 

B. FREQUENTLY U. RARELY 

NUMBER OF „ r 11 E 

RESPONSES A B C LI 

T^TA^^ 16.7^ 58.3I 25.ul 0.0? 0.0? 

-^•^ ^ 0.0? 100. ol 0.0? 0.0? 0.0? 

^''^ ' ^^.zl 33.3? 0.0? 0.0? 

SECONDARY U ^^J^ ^^^/^ ^5.0? O.O? O.O? 



Figure F-2. (Page 8 of 9) 
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l3/.nTLE VII IS h»-FbHlVfc IN PRCMJI ING THE ACADEMIC 
ACHlbVbHENI UF HISPANIC LhP SIUUENTS. 

A. ALMUST ALrtAYS C . SOME T IMES h.ALHUST NEVER 

B. FKEgUhNrLY U. RARELY 

NUMBER OF 





RESPONSES 


A 


B 


C 


0 


E 


rOFALS 




3 

33.34 


4 

44.44 


2 


0 

0.04 


0 

0.04 


JR HIGH 


I 


0 

0.04 


1 

100.0* 


0 

0. 04 


0 

0. 04 


0 

0. 04 


HIGH SCH 


d 


3 

37.5? 


3 

37.34 


2 

25.04 


U 

o.o:^; 


0 

0.04 


SfcCUNUARY 


9 


3 

33. 3i 


4 

44.44 


2 

22.24 


0 

0.04 


0 

0.0 4 



138.firLE VII HAS FACILIIATEU liEITER CUURUlNAflUN 

AMUNG tSL AND CONlEfU AREA TEACHERS FuK ASSISTING 
LEP STUuE.n LEARNING. 

A. ALMUSI ALr^AYS CSUMEFIMES E. ALMOST NEVER 

B. FKEUUUNTLY 0. RARELY 

NUMBER OF 

RESPONSES A B C 0 E 

rOTALS I'^/A^ 4 2 6 0 0 

' 33. 34 16.74 b0.04 0.04 0.04 

JR HIGH 2 0 0 2 0 0 

0.04 0.04 100.04 O.OS 0.04 

HIGH SCH 10 4 2 t 0 0 

40.04 20.04 40.04 O.Jt 0.04 

SECONDARY U t 2 6 0 0 

.33.34 16. 74 50. 04 J. 04 0.04 



Figure F-2. (Page 9 of 9) 
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RESPONSES TO OPEN-ENDED QUESTIONS ON TEACHER SURVEY 
(23 possible respondents) 

1. Do you find you are using new techniques to instruct LEP 

students because of Title VII trainirv^? Yes^ N o / If so, 
Please nane. 

0 Respondent #1 - No. 



0 Respondent #2 - Yes. 

— Lecture in small chunks of material 

— Fro^n time to time, pair LEP students with nonLEP students 

— Make vocabulary list every so often 

0 Respondent #3 - Yes. 

— More reading 

0 Respondent #4 - Yes. 

~ Small group activity demonstrated in class 

0 Respondent #5 - Yes. 

— Using slow, clear wording to give instruction 
~ Location of teacher in relation to LEP student 

Many more 

0 Respondent #6 - Yes. 

~ One-to-one instruction 

— The magic circle 

— Peer group instruction 

0 Respondent #7 - No* 

2. Are you using previously employed techniques now more than 
before? Yes U> No / If so, please name* 

0 Respondent #1 - Yes* 

— Foreign language methodology 

0 Respondent #2 - No. 
0 Respondent #3 - Yes* 
0 Respondent #4 - Yes* 

0 Respondent #5 - Yes* 

— Group answer or repetition first, 

then individual use of concrete objects, 
especially to introduce a new concept 



Figure F-3. (Page 1 of 3) 
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0 Respondent #6 - Yes. 

~ More clearly define objectives 

— More practice 

0 Respondent #7 - Yes. 

— Translation from English to Spanish 

— More repetition of instructions 

3. I have sufficient quantities of instructional materials In English 
and Spanish which address a range of readability levels. Ye s / 

No (/> Coments: 

0 Respondent #1 - No. 
0 Respondent #2 - Yes. 

0 Respondent #3 - No. 

— I do not have enough! 

0 Respondent #4 - No. 

0 Respondent #5 - No. 

0 Respondent #6 - No. 

~ I teach vocational Education 
(CVAE Food Service) so I adapt 
most of my material to suit my 
needs. 

0 Respondent #7 - No . 

— Most materials I have are for CLA classes 
and for ESL. No materials in Spanish are 
available for me. I do have a wonderful 
working relationship with foreign language 
colleagues. 

4. Describe any particular methods or rules you use to encourage your 
LEP students to use more English: 

0 Respondent #1 

— Have them define words in Englisn 
rather than translate them into 
their native language 

— Use ^nly English in the classroom 

— Give them plenty of opportunity 
to speak 

0 Respondent #2 

~ One-to-one ins.truction 
Magic circle 
Peer group instruction 

Figure F-3. (Page 2 of 3) 
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0 Respo^^dent #3 

~ Encourage LEP student to communicate 
with fellov friend in English 

— Ask questions/give responses in English 

— Encourage student to try to read 
newspaper and other English materials 

0 Respondent #4 

— No comment. 

0 Respondent #5 

~ Vocabulary pronunciation 

— Questions are to be asked in English 
if possible 

— Instructions are give in English, too 

— Read to understand and learn new words 

0 Respondent if6 

~ Have other students be a model for 
the LEP students 

— Give instruction in English only 

0 Respondent #7 
~ No comment. 



Figure F-3. (Page 3 of 3) 
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Attachment F-1 



Office of Research and Evaluation Staff Surveys 

The Office of Research and Evaluation (ORE) regularly conducts fall and 
, spring surveys of District teachers and administrators. In 1985-86 the 
fall surveys included a random 50% sample of teachers (excluding Chapter 
1, Chapter 1 Migrant, and State Compensatory Education teachers) and all 
campus administrators. Forty four items were assigned to 1781 teachers 
and 43 items to 153 administrators on the fall surveys'. For the spring 
surveys, all teachers not sampled in the fall were included, along with 
a few teachers, who had been surveyed in the fall who were involved in 
programs being evaluated. All campus administrators were surveyed in 
the spring as well as the fall. In May 148 items were assigned to 1894 
teaners, and 29 items to 155 campus administrators. 

Survey items were solicited from central administrators, program staff, 
and ORE staff in fall 1985. The fall surveys included primarily items 
on general topics, and the spring surveys included items needed for pro- 
grain evaluations. 

Survey forms were computer printed on scannable forms, with each staff 
member assigned appropriate items on a unique form. A complete outline 
of the techniques used appears in ORE publication #83.31, Appendices M 
and N. Each survey form was printed with a sequence number which 
allowed for matching surveys with mailing labels for sending the surveys 
through school mail. The sequence number also allowed the computer 
scanning and identification of items. 

Surveys were scanned ten days after the first mailing, and a second form 
printed "REMINDER" was sent to each person who had not already returned 
a form, ^en days after reminders were sent, the remaining surveys were 
scanned, responses analyzed, and printouts of results produced. The 
item response rates ranged from 65% to 98%. Printouts of items were 
sent directly to staff members who requested the information on January 
10 for the fall surveys and May 30 for the spring surveys. 
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Attachment F-2 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
Department of Management Information 

April 28, 1986 



To: Teachers and Campus Administrators 

From: Elaine Jackson 
Subject: Apologies 

Attached is the your regular spring survey from the Office of Research 
and Evaluation (ORE). We know it is too late in the school year to 
send surveys out to campus personnel. Unfortunately, on top of all the 
other assorted problems our District has been plagued with this year, 
the survey printing had to be completely reprogramraed this spring, and 
so it is late. We have eliminated all "general" questions from the 
survey, and kept only those items about programs you are involved with 
this year. For some of the small programs, this is the only source of 
data for the evaluator who will be writing up the program report, so 
we could not eliminate the survey. 

Because the survey is still important, it would help everyone if you 
would just sit down and complete it now, and save yourself from getting 
a reminder and wondering what you did with the first one- We do know 
this is too much to ask of you, but we must. Please feel free to write 
any comments you would like on the bottom or back of this sheet, and 
return it with your survey. All*^£ your responses and comments are 
confidential (the number on the survey is to indicate your grade level, 
location, and program). We do appreciate your help! 



Approved x^^^D^^^y^.^^ ^^[|^Liya-^ 



Director 

Department of Management Information 
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TUTOR RECORDS 
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TUTOR RECORDS 
Purpose 

University of Texas students who assisted LEP students on an individual basis 
in the content areas maintained tutor records which provided information 
concerning: 

Decision Question PI ; Should the Title VII program be continued as it 
is, modified, or discontinued? 

Evaluation Question Dl--5 > How do the English proficiency and achievement 
gains of students receiving tutoring compare to students who were not 
tutored? (Johnston experimental versus control group) (Murchison 
experimental versus control group) 

InfonBation Need IZ . Did the project meet its objectives? 

Inforaation Need 13 , In which content areas did project 
participants receive tutoring se.'vices? 



Procedure 

Students Served , Hispanic LEP students at Murchison Junior High and Johnston 
High School were assisted by University tutors during the fall school semester 
of 1985. During the spring semester of 1986, a third school, Anderson High, 
was added to those schools offering tutorial services to project LEP students. 

How Tutoring Was Carried Out . English speaking tutors were able to work with 
Hispanic LLP students by adapting and simplifying materials, e.g., with 
illustrations, r " -taking, clarification of vocabulary, utilization of 
Spanish/English wionaries, and identification of main concepts. 

Data Collection . Two sessions of University of Texas stuoents, enrolled in 
multicultural education courses, assisted project LEP students as tutors. 
Record forms which they maintained first semester provided the data about 
those students served between the first week of October and December 1985. 
However, not all record forms were received from tutors by January 28, 1986. 
Therefore, during the second semester both the tutors and their receiving 
teacher jointly shared the record-keeping responsibilities. 
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Results 



Information Need I3 > 

tutoring services? 



In which content areas did project participants receive 



Hand tallying done by the evaluation associate determined that during school 
year 1985-86, 76 project LEP students were tutored by 48 tutors in eighteen 
subjects • 



t Mathematics • 

t English • 

• Computers • 

• Science • 

• ESL • 

• Social Studies * 



Reading o 

An « 

Government • 

Biology • 

World Geography ^ 

Algebra t 



American History 
World History 
Geography 
Geography 
Texas History 
Earth Science 



Some of these students received tutoring in more than one area. In order to 
obtain this count, the evaluation associate created a SAS program 
(SA-BY0010205) using input from the tutor data file (SA-BY0010105) and a SAS 
PROC FREQ was run. Thus, in a duplicated count, 122 students were tutored in 
subjects in the content areas of reading, language, mathematics, social 
studies, and science. (See Figure 1 below.) 



SUBJECT 


GROUP 


FREQUENCY 


PERCENT 




Nontutored 


153 


50.533 


Reading 


Tutored 


16 


9.467 




Nontutored 


118 




Language 


Tutored 


51 


30.178 




Nontutored 


149 


88.166 


Mathematics 


Tutored 


20 


11.834 


Social 


Nontutored 


IBl 


89.349 


Studies 


Tutored 


18 


10.651 




Nontutored 


152 


89.941 


Science 


Tutored 


17 


10.059 



Figure 1. BREAKDOWN OF 122 STUDENTS TUTOREP 

(DUPLICATED COUNT) BY CONTENT ARL. - 
Frequency and percent of those tutored 
is compared to that of the nontutored. 
Total number of 1""* students available 
to be tutored was 169. 

As can be seen in Figure 1, project LEP students received the most assistance 
in language; 30 percent were tutored. Approximately 10 percent of the LEP 
students were tutored in each of the other subjects— reading, mathematics, 
social studies, and science. Also, some of the project students received help 
in more than one subject. 
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Evaluation Question Dl-S > How do the English profic'ancy afid achievement gains 
of students receiving tutoring compare to students >.no were not tutored? 
(Johnston experimental versus control group; Murchison experimental ^'ersus 
control group). 

In order to answer this question, the test scores of LEP A and B students on 
the LAB and ITBS/TAP were examined. On the LAB, which measures English 
language skills, both tutored and nontutored students showed significant gains 
(p § .0001). However, tutored students did not gain significantly more than 
nontutored students; the overall ^ains of the tutored students exceeded those 
of the nontutored by slightly more than one point. This dif'f'erence was not 
statistically significant. (See Appendix A, Language Assessment Battery, for 
more detailed information.) 

On the ITBS/TAP, Te tutored sample size w^*^ small, because the number of 
enrolled project s .jdents with sufficient bnglish proficiency to take the test 
for both spring, 1985 and spring, 1986 was limited. Thus, the number of 
tutored LEP students with test scores was less than 10 except in language. 
Therefore, significance testing was not run. In language, the tutored 
students* made average gains of .96 grade equivalents (GE) in a year, while 
nontutored students averaged gains of 1.60 GE years. (See Appendix B, Iowa 
Tests of Basic Skills/Tests of Achievement Proficiency, for more detailed 
Information.) 

Decision Question Dl . Should the Title VII program be continued as it is, 
moTifled, or disconti nued? 

Information Need 12 . Did the project meet its objectives? 

although the Title VII Program looked at the comparative English proficiency 
and achievement gains of tutored vs. nontutored project students on the LAB 
and ITBS/TAP, no objective criterion was measured during the program's first 
year of implementation. 

In terms of modifying the tutor program, some changes in the tutor component 
might enhance effectiveness. The program might consider setting requirements 
of a minimum number of minutes per project student. Some project LEP A and B 
students were omitted from the data analysis because they had received less 
than fifteen minutes of tutoring over the year. For inc^c students the time 
spent was probably too short to be effective. The program may also want to 
strengthen the training provided to tutors in ESL instructional strategies, 
since most do not know Spanish. Finally, some noh^roject students were also 
served by the tutors. Project students might receive more service if this did 
not occur. 



203 




APPENDIX 6 
4 



BOARD OF TRUSTEES 

Nan Clayton, President 
Bernice Hart, Vice President 
Lidia M. Pe'-ez, Secretary 
John Lay Ed Small 

Dr. Gary R. McKenzie Abel R. Ruiz 

SUPERINTENDENT OF SCHOOLS 

Dr. John Ellis 

DEPARTMENT OF MANAGEMENT INFORMATION 
DIRECTOR 

Dr. Glynn Ligon 

OFFICE OF RESEARCH AND EVALUATION 
ASSISTANT DIRECTOR 

Dr. David A. Doss 
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